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Preface 



Performance appraisal is continued in all types of organizations and groups. 
Postsecondary educational institutions are no exception. Postsecondary administrators 
appraise the actions of department heads, faculty . and support personnel to measure 
their contribution to the objectives of the institution. Some administrators perform this 
task perfunctorily and fail to see its value, while others see it as a valuable process. 
Members of the organization must receive feedback from others concerning the 
appropriateness of their behavior if the> are to improve productivity, correct errors, and 
grow professionally. 

Terms used to describe this process vary among professional groups. Performance 
appraisal also is known as performance evaluation, merit lating, performance review, 
performance and productivity assessment, and efficiency and fitness reporting. 
Performance appraisal has become the prefened term and is used in the most recent 
personnel and compensation textbooks and professional literature. The term evaluation 
should be avoided since it refers to those processes used to establish the internal worth 
of jobs. 

The process of performance appiaisal > arics from a series of informal assessments 
made by superiors who know their staff well to more structured systems which require 
superiors to complete various forms and make written comments. Many authorities 
contend that well-designed performance appraisal sy . terns are essential in effectively 
and legally managing human resources. 

In reality, however, few systems are totally successful. One reason is that superiors 
have great difficulty writing useful and objective performance appraisal reports. They 
are often reluctant to criticize a subordinate's woik and put the criticism in writing. 
Another problem is mere is no single approach that can fully addiess all the purposes 
that organizations attempt to achieve with performance appiaisal. As for equal oppor- 
tunity considerations, many sy stems used today arc not the solution but, rather, are part 
of the problem. A number of studies have shown ciitenon bias to be a serious short- 
coming, resulting in discrimination against blacks, ethnic minorities, and women. 
These systems may produce ratings that are subjective, impressionistic, non-job related, 
and unstandardized. When used to justify important personnel decisions, such ratings 
increase rather than decrease Equal Employ ment Opportunity (EEO) liability. 
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Fortunately, the failures of the past have led to increased emphasis on development 
of raters, more realistic expectations of what performance appraisal can accomplish, 
workable appraisal techniques, and effective strategies to deal with EEO regulations. 
Examples of effective performance appraisal systems can be found in all types of 
organizations including educational institutions. Turning die potential of performance 
appraisal into productive reality is a challenge but attainable goal facing those who 
manage the affairs of postsecondary education. 

With few exceptions, both faculty and administrators approach the performance 
appraisal process with some level of anxiety and apprehension. The editors have made 
a concerted effort in this book to relieve some of this anxiety by presenting the most 
pertinent information which will increase the understanding of basic knowledge that 
makes any performance appraisal system workable, fair to all parties, and legally defen- 
sible. While the editors recognize that many facets were omitted that could have been 
included, to do so would have made it unnecessarily long. 

This book is not intended to be a substitute for primary sources in the field, rather, 
it is meant to provide a concise framework for understanding the basic concepts of per- 
formance appraisal and serve as a functional tool for practitioners and scholars. In 
addition, our book is not designed to render legal advice or legal opinion. Such advice 
may only be given by licensed, practicing attorney, and only when related to actual fact 
situations. This warning is particularly pertinent becaust of the nature of the topics 
covered herein. Specific legal questions concerning personnel perfonnance appraisal 
should always be checked with the appropriate legal counsel. 



Betty c B. Burkhalter 
James A Buford,Jr. 
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Drmance Appraisal: An Overview 

Bettye B. Burkhalter 



Appraisal of performance of fauiltv, administrators, and support staff is an activity 
which has been identified as one of the most pressing issues facing higher education 
during the next decade. There are a number of reasons for this glowing concern includ- 
ing financial exigency, public pressure for accountability, and the continuing need for 
workabk approaches to reinforce the growth and development of individuals. As might 
be expected, this issue has generated considerable apprehension and skepticism, 
particularly on the part of faculty members It is the purpose of the authors to present in 
uncomplicated terms the ke> concepts, theories, practices, and constraints in this area. 
The focus is experiential and practical. Emphasis is made on the application of knowl- 
edge so that administrators mII g t jn a useful understanding of the topic and have a 
frame of reference to make the best possible decisions. 

Problems and Issues in Performance Appraisal 

Performance appraisal is widely recognized as an essential part of the management 
job in all types of organizations. It can provide a source of motivation to achieve 
organizational goals, a measure of work related contributions, and a vahiuole tool in the 
personal and professional development of individuals. Lnfortunatelv, performance 
appraisal is generally regarded as one of the weakest dements in the management 
process A recent survey of over 2,400 practicing mai agers combined with extensive 
review and anal) sis of 25 years of literature conclude mat "no industry or academician 
has comprehensively ^lved the problems in performance appraisal", in fact, "no two 
people completely agree on how to solve the is»v v." 1 The field has apparently no; 
progressed very far since 1972 when Cohen and Bra wet pointed out that ". . . we are 
still at the most rudimentary empirical stage (of performance appraisal]. . . / * 

If one accepts these conclusions, then it would seem that there must be certain 
inherent characteristics within the structure and piocesses of organizations which are 
contributing factors. Thomas F. Gilbert offers the following pessimistic and unflatter- 
ing assessments: 
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• Information is frequentl} inadequate and misleading, managers often do not 
really know how well people are performing. 

• Job models seldom exist to tell people preciselv what important results thev are 
supposed to accomplish, how these results are measured, a id what standards of 
performance are expected of 'hem. 

• Behavioral conditions for perfemiance are rarel> well supplied b> management 
to see that people have the best data, feedback, resources, procedures, incen- 
tives, and training in order to meet exemplary standards. * 

Finally, the topic of performance appraisal is viewed at worst as a necessary evil in 
private industry and many organisations in the publu sector. In the field of education, 
the reservations are much more serious, panic ularlv in regaid to post tenure appraisal of 
faculty. Formalized appraisal procedures are seen b> mail) as unworkable, detrimental 
to collegial relationships, and a threat to academic freedom.* 

While the authors recognize the aforementioned problems and issues, we remain 
optimistic. The results of the past 25 >ears of research and observations of organiza- 
tional practice do not support a conclusion that performance appraisal cannot \y 
accomplished. These results sinipl) suggest that designing and implementing a legal, 
accurate, and cost effective performance appraisal program is not an easy task. In fact, 
every organization must appraise performance because decisions must be made in such 
vital areas as tenure, promotion, . and merit pa> adjustments which require the measure- 
ment of work contributions. 

Evolving Purposes of Performance Appraisal 

A comprehensive performance appraisal svstem should provide the framework to 
make both administrative and professional decisions Michael Scriven\s "formative- 
summative" evaluation concept is widelv recognized and accepted/ Theoretically, d?ta 
from the formative dimension of performance' appraisal caii be used for professional 
development decisions, and data from the summative side can be rsed for personnel 
management decisions. 6 Man> educators, researchers, and practicing professionals, 
however, continue to voice the coinem that one appraisal svstem cannot serve both 
purposes." 7 ^ Wilkinson contends that attempts to construct a single comprehensive 
system which serves both formative summative functions would be an impossible task. 0 
Conversely, according to the research team of Darling Hammond, Wise, and Pease, the 
approaches are not mutuallv exclusive if the performance appraisal vields, on the one 
hand, objective, standardized information for accountability and, on the other, descrip- 
tive information for individual staff development. 10 

Although there u> disagreement among some of the authorities in the field regarding 
the dual use of a formative summative evaluation approach, as applied to a performance 
appraisal system, the controversv surrounding the supposed incompatibility between 
formative and summative purposes of appraisal is confined largely !o educational 
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research and writing. The issue does not receive a gicu! deal of attention in manage- 
ment literature, nor is it viewed to be a majoi problem in man) organisations. There- 
fore, the authors hold to the view that a .single approach, when carefullv des.gned and 
properly implemented, can serve a variety of purposes. 

Professional Development 

Man>' authorities consider professional development to be a ver> important aspect 
of performance appraisal. Research has led to the following conclusions. 

• Individuals are ver> interested in knowing more about the factors affecting their 
performance and their careers. 

• Administrators are reluctant to discuss these issues. 

• Most administrators have not found a direct approach to professional develop- 
ment issues. 11 

Using the results of performance appraisal in career development can help indi- 
viduals in identifying and overcoming blocks to their progress and in developing strate- 
gies for improvement as the> move through various stages of their career. This could 
be diagnostic, for example, statistically anal) zing the links between performance 
ratings and career stages. Ratings can also be used directly to help staff members 
understand what they must do to become or remain high performers. 1 - 

Placement in the Organization 

There are several types of placement decisions in which performance ratings may 
be used The first deals with an individual's advancement in the organizational struc- 
ture. Examples include faculty member to department chair, library technician to 
assistant librarhn, and comptroller to business manager. Job behavior and activities are 
often more revealing than tests and interviews for predicting future performance. Thus, 
positive performance ratings often are used as promotion criteria. It is unrealistic to 
assume that because individuals are performing well on a job that they will succeed at 
the next higher level, particularly when the) are considered for promotion from lower to 
upper level positions. Deliberations over which candidates will be chosen for promo- 
tions always should begin b> matching the requirements of the job with the applicant's 
qualifications It is possible to identify certain aspects of performance on a present job 
that can be useful in predicting performance in a different assignment. For example, if 
a faculty member received good ratings in chairing faculty committees, this would be a 
major consideration in a possible promotion to depattment head. On the other hand, a 
faculty member nho had difficulty with daily administrative details would be a poor 
prospect for an administrative assignment. 
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The second type of placeman deals with the professional iulhu than administra- 
tive hierarchy The most pervasive example is found in the faculty. Decisions must be 
made regarding the awarding of tenure and promotion in lank, and in some cases both 
at the same time For example, an assistant professor coald be tenured and piomoted to 
associate professor simultaneously. These t>pe decisions focus on different dimensions 
of perfonnance; however, accurate assessment of appiopnate behavior and outcomes 
such as teaching success and community service can still be achieved. 

Placement also has a negative aspect. An mdiv idual who is performing poorly may 
need to be transferred into a new job in which prospects for adequate performance are 
feasible. Again, performance appraisal results that identify both strengths and weak- 
nesses can provide information about the type of job that better utilizes^ individual's 
strength. These results reduce or eliminate those areas where deficiencies exist. 

There will be cases where, regardless of the best efforts of the organization an 
individual is either unwilling or unable to meet reasonable expectations of job perfor- 
mance. In these cases, it is necessary to use tin results of perfonnance appraisal for 
^uch adverse actions as demotion, suspension, probation, 01 termination. 



Compensation 

An organization's reward system includes anything an employee values that the 
employer is willing to offer in exchange foi the employee \ contnb itions. One impor- 
tant reward is compensrtion. It is logical that the amount of an individual's salary 
increase should be related to job performance during a specific period. Many organiza- 
tions base the amount of merit raises directly on performance ratings. There are three 
reasons to relate salary to performance. First, as a society ve are committed to a sense 
of equity that suggests that rewards and perfonnance' should be related. Second, 
research in motivation shows that if compensation is to be a motivator, people must see 
a clear, positive correlation with performance Third, research also shows that out- 
standing performers prefer to work in and remain in meritocracies. ^ 

There are authorities in the field who feel that compensation decisions should not 
be linked to performance appraisal. The contention is that during the perfonnance 
appraisal conference, the individual is most concerned with the amount of the raise and 
not with such important matters as productivity improvement and professional devel- 
opment. Therefore, an employee is likely to concentiate on how the lating will translate 
into dollars and to ignore all else. 

While this issue cannot be resolved completely , it seems reasonable that if an orga- 
nization is willing to invest the time and resources needcJ to develop a job-related 
performance appraisal system, the results should be used in the compensation program. 
The argument that if individuals know their pay increases are related to performance 
ratings, the other purposes of perfonnance appraisal somehow will be minimized can be 
stated conversely. The person may feel that if ratings hav e no influence on salary, then 
the organization is not serious about performance appraisal. 
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The major concern with using performance appraisal results m compensation pro- 
gram decisions is whether or not the s> stern Jctiull\ measures cmplo>ee contributions. 
Most of the dissatisfaction w ith merit pa> can be 4 tKued directlv to s\ stems that produce 
highly subjective and frequentl) meaningless ratings. Such ratings ha\e little to do with 
how well people fulfill their obligations to the organization. 

Legal Considerations 

Performance ratings, when used to justify divisions related *o such areas as promo- 
tion, merit pay, and terminations, are subject 10 federal and state laws and regulations 
which prohibit discrimination based on race, color, sex, religion, national origin, age, 
and handicapping condition. The centerpiece 1 * of EEO Legislation is Title VII of The 
Civil Rights Act of 1964. Beginning with the landmark case, Griggs v. Duke Power 
Company, both the courts and the Equal Employment Opportunity Commission 
(E£OC) have mandated that appraisals be based on criteria which aie valid or job 
related. While it is not impossible to prove job relatedness to the satisfaction of a com- 
pliance agency or court, certain essential steps must be followed. What is required, M . . . 
at a minimum, is a degree of logical argument and factual evidence, not just a subjec- 
tive appeal to intuition and so-called common sense." 1 * 

An institution which loses a Title VII case is subject to back pay awards which can 
be substantial in a class action suit. In addition, courts usuall) allow the prevailing 
party to recover attorney fees. There have been cases where courts have found defen- 
dants to be personally liable for violating the rights of individuals. Finally, a court is 
likely to impose hiring and promotional quotas, as well as requiring the employer to 
revise its selection practices. Even if the employer wins, a la* suit is very costly. Time 
and resources invested in research and analvsis, answering interrogatories, and prepara- 
tion for trial, unlike attorney fees, cannot be recovered. 

The Selection of a Performance Appraisal Technique 

Many performance appraisal methods and techniques are used today. As might be 
expected, no method can be expected to accomplish all of the objectives of the process 
and all have advantages and disadvantages. The selection of a method or combination 
of methods should be based on accommodating legal requirements, current research; 
proposed uses of appraisal results, institution t>pe, climate, and mission, and organiza- 
tional resources. 

It is probably safe to suggest that there are a number of techniques wiuUi are both 
effective and legally defensible and an equall) large number which should be rejected 
out of hand for failing on both counts. A somewhat neglected area is cost versus bene- 
fits. As will become evident, the development and administration of a performance 
appraisal program is expensive, and the value of post appraisal benefits such as 
increased motivation and better administrative decisions should be at least equal to the 
costs in time and resources. 
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Criterion Oevelopmer; 

Regardless of the technique used to measure job performance, the adequacy of the 
criteria measures is a critical issue. There arj various t>pes of job performance 
measures which can emphasize both work output and judgmental data. Work output 
can be observed and tabulated such as number of important committees chaired, 
number of public service activities conducted and the number of professional presenta- 
tions and publications. Such measures are seen to be highly objective. In fact, one 
advocate of such measures in appraising performance of faculty members uses the 
expression "either you did it or >ou didnV'n There is little question, however, that 
judgmental data is unavoidable. Most jcbs require information from superiors who 
directly and continuously oServe the quali > of the work. The distrust of these kinds of 
measures and the possibility of bias make it essential to carefull) develop and scale 
behavioral measures. 

In criterion development, job analysis selves both a legal and technical purpose. 
The legal role is well established in both the 'Uniform Guidelines" and in a series of 
court decisions. A thorough and competent job anai>sis establishes the rational link 
between the content of the job and the content of 'he performance measure. According 
to Donald Schwartz, EEOC personnel research psychologist, "the absence of a job 
analysis is fatal to a validity study in a court challenge." ^ 

In regard to the technical or professional requirements for job analysis, there are a 
number of acceptable methods. In selecting a method or technique, the focus should be 
on ensuring that the method or combination of methods representatively samples 
significant job tasks Although it is highly desirable, it is not possible to specify one 
clear, suitable, standard means for meeting all the technical and l^al considerations of 
a job analysis.' 7 The lack of such a standard, however, should not be viewed as a major 
problem. 



Measurement Accuracy 

The final outcome of a performance appraisal program is, of course, the rating. 
Unfortunately, the process is not self regulating. Measurement accuracy is a serious 
concern; in fact, various types of later errors can undermine the validity of the most 
carefully designed system Performance appraisal programs must have the support of 
top administration; much more than a speech and a cover memo. At a minimum, all 
levels of management must take performance appraisal programs seriously. 

It is also necessary to address tendencies and perceptual inaccuracies of raters. 
There arc a numbc- of common sources of error in performance appraisal which can be 
controlled with an adequate rater training program. While these problems cannot be 
completely eliminated, both accuracy and reliability can be brought to manageable 
levels. 
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Instrumentation 

Finally, there is a need to set concepts and theories into operation so that perfor- 
mance appraisa* Ldn ^ implemented under standardized and controlled conditions. 
Instrumentation often does not receive adequate attention. In too man) cases, the actual 
performance appraisal forms are either "off-the-shelf or poorly designed. Each organi- 
zation will, of course, have different requirements depending on the technique that is 
selected. 



Concluding Comment 

This discussion has raised a number of important issues regarding performance 
appraisal in postsecondar> institutions and there arc obviously many others. It should 
be apparent that there is no perfect solution to the problem of measuring work-related 
contributions to objectives. But the point is that performance appraisal is an essential 
part of the management job. There is real value m the process and the forces pressing 
for performance appraisal will onl> become stronger. While it is important to seek help 
from the literature, it is also possible to be overwhelmed with conflicting information. 
Too often this leads to a feeling of futility and a decision to avoid facing the issue until 
a unified model has appeared. This will not happen. The task of institutions is to inte- 
grate proven concepts into their own model, avoid the mistakes of others, and move 
forward. 
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Legal Aspects of Performance Appraisal 

James A Buford, Jr. 



Although most of the attention in the area of equal employment opportunity has 
been focused on recruitment and selection, the performance appraisal process is subject 
to the same laws and guidelines Decisions related to promotion, selection for training 
programs, wage and salary administration, discipline, and even dismissal come from 
performance appraisal results. Title VII of the Civil Rights Act of 1964 prohibits 
employment discrimination based on race, color, religion, sex, or national origin. The 
Age Discrimination in Employment act of 1967 prohibits discrimination against people 
age 40 and over The Equal Eniplo>ment Opportunity Commission (EEOQ has been 
given legislative responsibility for enforcing these acts. In 1966 the EEOC issued its 
first set of "Guidelines" relating to the emplover's obligation to develop nondiscrimi- 
natory personnel procedures. They were revised in 197(fand again in 1978.* 

Major Court Decisions 

In 1971 the U S. Supreme Court in Griggs w Duke Power Company issued a land- 
mark decision regarding Title VII. i he effect of the Court** decision was to establish a 
requirement that if any employment practice or "test" has an adverse impact on 
members of a protected group, the emplo>er must demonstrate that the practice is valid 
or job-related ? The decision also gave the EIZOC "Guidelines" essentially the force of 
law in developing personnel procedures Performance appraisal results, when used to 
justify personnel decisions, are clearly covered by Title VII and related laws. 

f.i 1973 the court stated m Brito v. Zia Company that the organization had violated 
Title VII when, on the basis of poor performance' ratings, it laid off a number of 
employees < The court said the practice was illegal because ;l) a disproportionate 
number of Hispanic workers were laid off and (2) the performance appuisal instrument 
was not related to important elements of work behavioi but was based on "the best 
judgments and opinions of supervisors" and was not administered and scored under 
controlled and standardized conditions. The decision also cleailv established that per- 
formance ratings were employment "tests." 
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There was a similar case involving a university in 1974. In Wade v. Mississippi 
Cooperative Extension Service, a U.S. District Court noted that what the organization 
had called an "objective appraisal of performance" actually was based on supervisory 
ratings of traits such as leadership, public acceptance attitude, grooming, personal con- 
duct, outlook on life, resourcefulness, and loyalty ^ The couit ruled that the results of 
such appraisals retained black employes in nonsupervisory positions and that the 
results could not be used as promotion criteria. The court ordered the Extension Service 
to develop an appraisal system that would meet the requirements of the EEOC 
"Guidelines." Both of these cases are classic examples of di^nmination as defined in 
the Griggs case. 

In 1975 the U.S. Supreme Court ruled in Aibetmarle v Moody that because job 
analysis had not been conducted, the company could not use performance appraisal 
ratings to validate selection requirements which eliminated a disproportionate number 
of black applicants/ The importance of adequate job analysis continues to be empha- 
sized. In Greenspan v The Automobile Club of Michigan, a case brought in 1980, the 
court criticized the method used in anal> zing jobs, stating,. "The analyst did not verify 
job description by making an on-site inspection of the employee who actually per- 
formed the job. . . The major requirement in job analysis for performance appraisal 
purposes is to ensure that the d^ta collected provides accurate information about work 
behaviors critical on the job. 

EEO Liability 

EEO laws and court decisions attempt to eliminate race* sex, or age discrimination, 
and liability can be triggered in at least three general ways, intent to discriminate, dis- 
parate treatment, and disparate or adverse impact. 

Intent to discriminate was the major consideration m discrimination cases prior to 
the passage of Title VII. Persons seeking recourse had to prove that the employer 
deliberately set out to discriminate against them on the basis of race (there was no pro- 
hibition against sex or age discrimination). Intent to discriminate is evidenced by the 
following examples: 

• A rater delibc itely gives lower performance ratings to black employees. 

• Prejudicial statements are made such as "blacks cannot handle management 
responsibilities." 

• Policy statements endorse illegal practices such as job segregation. 

At the present time, intent to discriminate i:, not a major factor in EEO litigation; 
however, evidence of such actions will discredit any defense raised by an employer. 

Disparate treatment occurs when members of protected groups are treated differ- 
ently from other employees. Examples of this include: 
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• A black and white emplo>ee receive different ratings when there is no observ- 
able difference in job performance. 

• Male employees receive da> -to-day counseling to improve their performance 
ratings. Female employees do not. 

Disparate treatment is a frequent cause of discrimination complaints. Under 
present law it is not necessary to provide evidence of "evil intent", all that is required to 
establish the fact that a procedure or practice ls not earned out consistently between 
individuals or groups. 

Disparate impact occurs when barriers which appear to be neutral have an adverse 
effect on members of protected groups. There may be no intent to discriminate or 
evidence that one group or individual is treated differently from another. In many 
cases, statistics alone are sufficient to establish disparate impact. The EEOC and the 
courts have adopted the 80 percent rule for such cases. The rule states that any selec- 
tion ratio (e.g., number promoted vs. number eligible) for members of protected groups 
must be at least 80 percent of the majority selection ratio. 7 Examples include: 

• A statistical analysis reveals that blacks receive significantly lower performance 
ratings than whites. 

• Performance ratings lead to differential promotions, training opportunities, merit 
raises, or dismissals. 

Disparate impact focuses on the effect of practices and procedures rather than the 
causes. Another term that is used for disparate impact is systemic discrimination. 

Intent to discriminate and disparate treatment can involve individuals or groups of 
people who are members of a protected class. Disparate impact normally involves 
groups. The existence of any one can start a chain of events known as the EEO liability 
process. 7 

Typically, an organization first lc >rns that it has been accused of discrimination 
when it receives a notice of charge from the EEOC. If there is a state fair employment 
practices agency, the EEOC must defer to that agency before beginning its own investi- 
gation, The deferral agency may process and settle the charge. If the charge is not 
settled, or the agency waives jurisdiction, the EEOC will re-assume jurisdiction. The 
EEOC will first invite the employer to attend a "no-fault" conference to resolve the 
co^olaint. If, in the opinion of the EEOC representative, the charge has merit, there 
will be an attempt to obtain a settlement. If the charge is found to be without merit, the 
EEOC will issue a "no-reasonable-cause" finding. 

If the representative is unable to settle a charge which is thought to have merit, the 
EEOC will then conduct a full-scale investigation. The EEOC has the authority to 
subpoena and question witnesses under oath. If the investigation results in a finding of 
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"cause/ 1 the EEOC w ill again attempt to conciliate the matter. At tins point, concilia- 
tion remedies might include back pay, promotion, changes in procedures and relief for 
others similarly affected If the investigation reveals "no-reasonable-eause," the EEOC 
will issue a right-to-sue letter to the complainant. Faced with a finding of "cause; 1 the 
organization will often elect to settle the case rather than lake a chance on losing in 
court. If conciliation fails, the EEOC has direct access to the courts, and will consider 
litigation based on the merits of the case. Actually, most charges do not result m litiga- 
tion but are resolved through administrative action. 

If the case goes to courts the complainant (plaintiff) must, as shown earlier, prove a 
prima facie case of discrimination b> showing intent to discriminate, disparate treat- 
ment, or disparate impact. This is the first burden of proof in a discrimination case and 
is always carried by the plaintiff. 

Once the plaintiff has established a prima facie case in a disparate treatment claim, 
the employer must articulate some legitimate, non-discriminatory reason for making the 
decision. When disparate impact is established, the emplo>er must shew that the 
practice or procedure has a "manifest relationship" to the job in question. This holds 
even when the criteria are, by necessity, "subjective or discretionary" in nature. The 
employer may show that the practice is necessary to fill a legitimate business 
requirement. This is known as the defense of "business necessity." Another defense is 
to demonstrate that the practice is valid or job-related according to the "Guidelines." 
There are variants and combinations of these defenses, but the important point to 
remember is that, once a prima facie case has been established, the employer is 
presumed to have violated Title VII unless the emplo>er can show otherwise. 8 The 
second burden of proof (some authorities use the term burden of production) in an EEO 
case is always carried by the employer. 

If the employer's defense is successful, the plaintiff must show that the employer's 
-easons were, in fact, only a pretext, or that alternate selection methods having less 
adverse impact are available. This third burden is carried by the plaintiff. EEO cases, 
however, are normally decided on the basis of whether or not employers can demon- 
strate that their practices are job-related (see Figure' 2. 1 ). 

The discussion above outlines how a charge would typically be" decided in a court 
case. Most charges, of course, do not result in actual litigation, but are resolv ed by the 
EEOC or state agency through administrative action, either b> a "no cause" finding, or, 
if "reasonable cause" is found, through conciliation. 9 

An employer who loses a Title VII case is subject to back pay aw aids (which can 
be substantial in a class action suit). Also, courts normally allow the prevailing party to 
recover attorney fees. There have been cases where courts h ive found defendants to be 
personally liable for violating the rights of individuals. Finally , a court is likely to 
impose hiring and promotional quotas, as well as requiring the employer to revise its 
practices. Even if the employer wins, a lawsuit is very costly. Time and resources 
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invested in research and analysis, answering interrogatories, and preparation for trial, 
unlike attorney fees, cannot be recoveied. 

There are three basic approaches that may be used b> an employ ei to minimize 
EEO liability. The first is to hire, promote, and administer salaries without regard tc 
perfomiance. For example, promotions LOiild be based on seniority, and across the 
board raises could be given. The employer could thus ensure that there would be no 
adverse impact, and a prima facie case could not be established. The second approach 
would be to continue current invalidated practices and wait for the EEOC or minority 
applicants or employees to take legal action. Many organizations follow th:s practice. 
A third anproach would be to assume that performance appraisal practices will have 
adverse impact and validate each practice in accordance with the "Guidelines." 

The third approach is recommended. The idea of being prepared to defend the 
organization's performance appraisal practices after a prima fane case has been estab- 
lished does not mean that adverse impact is something that should not be avoided 
whenever possible. One does not purchase automobile liability insurance with the 
intention of causing a traffic accident. In fact, insured motorists are likely to be safer 
drivers. It is also true that job- related performance appraisal practices have less adverse 
impact. 

A Validation Strategy 

The goa"l ot minimizing EEO liability is realistic and well within the capability of 
any organization. Although no system can be made "lawsuit proof," there are measures 
which can reduce the possibility of systemic discrimination. The approach recom- 
mended here is based on a strategy of validation. B> requiring the validation of perfor- 
mance appraisal systems according to the "Guidelines," this strategy ensures adequate 
defense if an employer is charged with discrimination. 

Not all authorities in personnel Management recommend the strategy of validation. 
One view held by the opposing group of practitioners, writers, and consultants is that 
validation can be done only by experts and that another strategy, namel) reducing or 
eliminating adverse impact, is preferred. Although it is true that validation is required 
only where a practice is having an adverse impact, such reasoning is not compelling. In 
the first place, if one accepts the definition of validity, that a procedure or "test" 
measures what it purports to measure, then validity itself is a legitimate end. Why 
would an organization not take steps to ensure that its performance appraisal system 
was measuring job performance? Another problem with a strategy of reducing adverse 
impact is that this approach implicitly questions whether members of protected groups 
can perform adequately even when the system is fair. They can and do. Finally, the 
'Uniform Guidelines" provide validation methods, and one of these (content validity) 
can be accomplished without the need for statistical expertise. A checklist for legal 
requirements is shown in Appendix B. 
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Reducing or eliminating adverse impact and improving the utilization of protected 
group members in all parts of the v ork force is more properly an objective than a strat- 
egy. Employers who find themselves accused of Title VII violations because members 
of protected groups are either rejected for promotion at a disproportionate rate, under- 
represented in the work force, or receive lower pa> are usually unable to successfully 
defend in court the practices in question. An analysis of these cases strongly suggests 
that these employers have almost always waited until they got into trouble before they 
attempted to justify their practices, many of which were not job-related. These employ- 
ers were, to use a common expression, "a day late and a dollar short." Thus, a strategy 
of validation would seem to have two major advantages. First, it addresses the problem 
of systemic discrimination, which Congress and the courts have identified as the major 
barrier to fair employment. Second, validation contributes to better administrative 
decisions. 

The best sratcgy for demonstrating that a performance appraisal system is job- 
related is known as content v alidity, in whi .h a procedure is justified by showing that it 
representatively samples significant pans of a job. The following excerpts from the 
"Uniform Guidelines" define content validity in more detail. 

A selection procedure* may be supported by a content validity strategy to the 
extent that it is a represenrative sample of the content of the job. 

. . a content validity strategy is not appropriate for demonstrating the validity 
of selection procedures which purport to measure traits or constructs such as 
intelligence, aptitude, personality, common sense, judgment, leadership, and 
spatial ability. Content validity is also not an appropriate strategy when the 
selection procedure involves knowledge, skills, or abilities which an employee 
will be expected to learn on the job. 

There should be job analysis which includes an analysis of the important work 
behaviors required for su.cessful performance and their relative importance. 
Any job analysis should focus on work behavior(s) and the tasks associated 
with them. 

To demonstrate the content validity of a procedure, a user should show that the 
behaviors demonstrated in the selection procedure provide a representative 
sample of the work product of the job. . . . The closer the content and the 
context of the selection procedure are to work samples or work behaviors, the 
stronger is the basis for showing content validity, w 



1 he term selection procedure refers to any procedure used for any employment deci- 
sion; thus a performance appraisal procedure is a selection procedure within the 
meaning of the "Uniform Guidelines" (see Section 16Q). 
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Related Considerations 

While the elassie defense against adverse impact is tor the employer to show job- 
relatedness, the situation is not so simple with performance appraisal. Suite it is diffi- 
cult or impossible to develop a complete!) objective system, there alwa>s will be ele- 
ments of supervisory judgment. Courts have varied their criteria for finding discrimi- 
nation. Factors which are considered include, the facts in the case, the degree of 
adverse impact; if the criteria are objective, subjective. 01 some combination, and 
whether or not the practice operates to perpetuate the effects of earlier intentional 
discrimination.il Thus, extreme care should be taken in the choice of measures, 
standardization and control of ratings, training of raters, and anal) sis of results to ensure 
that ratings are not biased by (age) race, color, sex, national origin, or religion. i- 

Two recent studies examined empirical!) the effects of 13 appraisal system 
characteristics on the verdicts in 66 federal court cases involv ing charges of discrimina- 
tion. Five characteristics were found to correlate strong!) with judgments for the 
defendants. 1 -' 

1. Type of Organization - Public sedoi organizations were more likely to 
receive a favorable verdict than private businesses. 

2. Provision of Written Instructions - Many courts have held the view that the 
provision of written instructions, while no guarantee, is a piereijuisite for systematic, 
unbiased appraisals. 

3. Traits vs. Behavioral-Oriented Appraisals Com is are far more likely to 
accept behaviorally-based performance appraisal systems. 

4. Use of Job Analysis - Defendants have won approximately 82 percent of the 
time when the system was based on job analysis. 

5 Review of Appraisal Results - Defendants weie nioic successful when results 
of the appraisal were discussed with the employee. 

"At Will" Liability 

Beginning v.ith the industrial revolution, the employ ee-employei relationship in the 
United States has been covered by the common law dounnc of "employ ment-at-w ill." 
Undei this doctrine, either the emplo)er oi employee can terminate the relationship at 
any time and without giving reason. 

The doctrine clearly favors the employer, since it contains the right to arbitrarily 
dismiss an employee. Increasingly, however,, this light has become subject to both 
statutory and judicial restrictions. As has been pointed out, the effect of federal EEO 
laws has become a majoi constraint. In recent years, however, both federal and state 
courts have created new legal rights for employees including those who are not 
members of protected groups (women, minors , , persons over 40, etc.). In regard to 
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performance appraisal, employers may encounter legal liability when they attempt to 
discharge employees for poor performance. Two impoitant sondes of at-will liability 
involving performance appraisal are breath of contrau ai 1 violation of the implied 
convenant of "good faith and fair dealing."* * 

There have been a number of successful lawsuits where the employer has been 
charged with breach of contract Representation made in employee handbooks, poli- 
cies, procedures, and direct or indirect statements are implied contracts. Once a 
contract has been found to exist, either in fad or by implication, the employee has a 
legal claim if its terms are not followed. The common chum of breach of contract is 
when employers fail to follow their own specified procedures when discharging 
employees for poor performance. 15 

Courts are also allowing wrongful discharge suits where termination constitutes a 
violation of the implied convenant of "good faith and fair dealing." Arbitrary and 
unexplained firings are often overturned, and courts are making it clear that employees 
are entitled to varying amounts of organizational due process.^ Employees of public 
institutions have additional due process rights guaranteed by the 14th Amendment to 
the US Constitution In other words, an employee who is being dismissed or pressured 
to resign (constructively discharged) for poor performance should have an opportunity 
to defend his or her performance and be judged in a fail wa> with explicit knowledge of 
the criteria on which the dismissal was based. 



Closing Remarks 

Disparate impact is a major issue in all personnel procedures. It is unrealistic to 
assume that performance appraisal systems can be designed which will never cause 
disparate impact or can be made court-proof by establishing business necessity or job 
relatcdness. Moreo-er, the area of at-will liability is still evolving. But it has been 
demonstrated that a performance appraisal system that avoids court problems encoun- 
tered by other oiganuations, that meets the validity requirements of the "Uniform 
Guidelines;' and that is administered by trained raters under standaid./xd and controlled 
conditions will greatly reduce the potential for legal liability. 
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Considerations in Selecting a 
Performance Appraisal Technique 

James A Buford, Jr. 



Performance appraisal systems are built around a number of methods and tech- 
niques. In selecting a technique (or combination of techniques) the institution should 
consider the following: 

1 . Does the technique accurately measure job pei formance? 

2. Does it meet legal requirements? 

3. Who will perform the appraisal function? 

4. Can it be administered efficiently? 

5. Are the post-appraisal benefits in the areas of pioduittvit), motivation, and 
decision-making likely to exceed the costs? 

To provide a basis for answering these questions, we will explain the characteristics of a 
number of performance appraisal methods and techniques, the various sources of 
appmsal data, and conclude with an approach to the question of costs \s. benefits. 



Overview of Performance Appraisal Techniques 

Many performance appraisal methods and techniques are used today. No method 
alonp can be expected to accomplish all objectives of the performance appraisal 
process, and all have advantages and disadvantages. The methods described in this 
section are those that are most common. They include graphic rating scales, essay 
appraisals, comparative methods, checklist methods, critical incidents, performance 
standards, behavioral scales, and management by objectives. 
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Graphic Hating Scales 

Introduced in 1922, the graphic rating scale is the oldest and most commonly used 
performance appraisal technique. 1 An example is provided in Figure 3.1. In this 
method, a scale u used to rate the individual on several factors. The rater scores each 
factor on a continuum from low to high. 

Graphic rating scales vary in two important ways, both having a major impact on 
reliability and validity. 

The first way that graphic rating scales var> involves the Fat tors to be rated. These 
may be a list of traits such as leadership ability, mitiati e, honesty, and attitude. The 
problem with these factors is that they are highly subjective and may not apply to the 
job. For example, it is difficult to define and measure a trait such as leadership ability. 
Moreover, this trait will not always be relevant, as in the case of a bookkeeper. In most 
cases, trait-based scales will not meet validity requirements of the EEOC and the courts 
when used to justify decisions regarding promotion, merit increases, and dismissal.- 

Figure 3.2 is a rating scale format that has been dimensionalized and weighted. 
These factors are based on job domain* or major responsibilities and the relative 
importance of each as established by job analysis. When used with an accurate job 
description, this format is very job-related. In a more detailed version of the dimen- 
sionalized rating scale format the factors to be rated describe actual job behaviors and 
are known as performance standard*. An example is shown in Appendix A. In general, 
the more factors there are that are job-specific and can be either quantitatively measured 
or at least observed, the higher the degree of reliability and validity that can be 
obtained. 

The second way that graphic rating scales vary is the manner in which total scores 
are assigned. In many cases, ratings are simply added together, however, the additivity 
assumption may not be valid because the factors are not equal in importance. 

Ratings are more meaningful when they are weighted in accordance with their 
importance to overall job performance. With quality job analysis, it is possible to 
develop rating scales diat are weighted on an appropriate basis such as amount of time 
spent, frequency of performance, or relative importance For example, the factor used 
to rate instruction probably would receive a greater weight man community service, 
even when both are part of the job. About 7 r percent of graphic rating scales used 
today are similar to the one shown in Figure 3.1. They are unweighted and are focused 
on traits rather than job-related behaviors. 3 

In isolation, a trait-oriented scale is of little use in providing feedback to individ- 
u* ' ^ improvement. However, graphic rating scales are relatively simple to develop, 
easy to understand, and less time consuming to administer than other techniques. They 
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EMPLOYEE RATING FORM 

Name Classification 

Department Date _ 



RATING 



PERFORMANCE 
FACTORS 


Poor 
1 


Fair 
2 


Average 
3 


Good 
4 


Excell 
5 


1. Knowledge 


□ 




□ 


□ 


□ 


2. Initiative 


□ 


□ 




[I 


□ 


3. Cooperation 


lJ 


n 


i J 


□ 


□ 


4, Dependability 


□ 


□ 


u . 


, — ) 

u 




5. Adaptability 


□ 


□ 


i — i 


r — | 


□ 


6. Attitude 


□ 


□ 








7. Judgement 


□ 


□ 






□ 


8. Creativity 


n 


□ 


p— 1 


( — \ 
t ' 


r— n 

1 J 


9. Leadership 


□ 


H 

i ! 








10. Punctuality 


□ 


□ 




1 , 





COMMENTS: 



Employee Signature Date Supervisor Signature Date 



Figure 3.1 Graphic Trait Rating Scale 
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PERFORMANCE 
APPRAISAL FORM 



PARTI IDENTIFICATION 



Name Richard W Martin 

Position Faculty Membe r 

Rating Period Prom .10,186 _ _ 

Rate' Name Douglas Brown 

Rater T.tle Depa rtmen t Chair 

Department Social Science 



To 



9 31 87 



Oate Employed . 



9 1 80 



Rating Scale Key 



Q] Fails to Meet Job Requirement* 
CD Essentially Meets Job Requirements 
CD Fully Meets Job Requirements 
0 Meets Job Requirements with 

Distinction 
[U Exceeds Job Requirements 



PART II RATING SCALES FOR MAJOR RESPONSIBILITIES 



A Instructional Planning and Preparation PCT 10% 


RATING 


□ 


□ 


□ 


□ 


i 

D 


Developing and maintaining course outlines selecting instruct-ona! 
aids, and preparing classroom presentations 


COMMENTS 












8 Instruction pct 50° 0 


RATING 






□ 


□ 


s 

□ 


Teaching classes as scheduled, presenting material information 
and skills to be learned, and providing for student evaluation 
o< instruction 


COMMENTS 












C Testtng and Evaluation PCT 10% 


RATING 






□ 


□ 


s 

□ 


Developing and administering appropriate assessment procedures 
for determining student achievement, providing feedback to 
students, arid determining final course grades 


COMMENTS 












D Student Affairs PCT 10% 


RATING 




L 


c 


c 


s 

□ 



Assisting students in curriculum planning, sponsoring student 
clubs and participating m campus activities and provfamg 
assistance with job placement 



E Administration 



PCT 10% 



Maintaining office hours, attending meetings and carrying out 
committee assignments, following appropriate procedures a,ui 
policies for submitting reports, requesting supplies and equipment 
and fulfilling other duties or assignments 



F Professional Development 



PCT 5 % 



RATING 

COMMENTS, 



RATING 



Pursuing personal professions! improvement program partici comments 
paling in programs, workshops, and classes to maintain credentials 
»nd competencies 



G Community Service 



PCT 5 % | RATING 

Serving as a resource person and providing advisory services withm I comments 
assigned subject matter area, and contributing to welfare of 
community through participation in areas o< interest 



Figure 3 2 Dimensionalized Rating Scale 
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can be highly job related and can be combined with other methods such as behav- 
iorally-phrased essays. To make ratings more meaningful, the rater, along with com- 
pleting the scale, may be asked or required to justify the rating and to discuss 
suggestions foi improvement in space prouded for written comments. 

Essay Appraisals 

The narrative essay is u description of the individual's job performance in the 
rater's own words. Often, guidelines are provided. For example, the rater may be 
asked to describe such things as strengths, weaknesses, and potential and to make sug- 
gestions for improvement (see Figure 3.3). The essay approach to performance 
appraisal assumes that a candid statement from a knowledgeable supervisor about an 
individual's job performance is just as \alid as more formal and quantitative methods. 4 

Narrative essays can provide detailed feedback regarding job performance, par- 
ticularly if the rater uses an accurate job description to ensure that all areas are covered. 
Most essay appraisals, however, are unstructured and vary in length and content. 
Another problem with essay appraisals is that the individual's rating may depend more 
on the writing skills of the superior than on the individual's performance. 5 Finally, this 
method is highly subjective, time consuming, difficult to administer, and impractical 
for large groups.* Most authorities agree that the essay is best used as a supplement to a 
more structured method such as the graphic rating scale. 

Comparative Methods 

Comparative methods comp re individuals against each other rather than against 
standards. Individuals may be compared on measures relating to overall job perfor- 
mance or on several traits or work characteristics. All comparative methods assume 
that job performance is distributed along a continuum from poor to outstanding. This 
idea is popular in the military and in the corporate world, where one hears such terms as 
"top five percenter" and "fast track." The results of these methods produce a listing of 
individuals from first to last in order of performance. Figure 3.4 illustrates how ranking 
involves placing individuals in order of overall performance, normally by first selecting 
the best and worst performers, then designating next bei,t, and continuing until all indi- 
viduals have been ranked. Figure 3.5 shows how paired comparison requires that 
individuals be compared one at a time with every other individual, with the final task 
rank determined by the number of times an individual was rated better than the other 
individual. In the forced distribution method, the rater assigns a specific proportion of 
individuals to predetermined performance categories, as shown, in Figure 3.6. 

The most elaborate of the comparative methods is founded on the principle of the 
normal distribution and is analogous to grading on the curve, in which there are a few 
A's and F's, slightly more B's and D's, and a large number of C's. That there is some 
proportion of outstanding, good, fair, and poor performers in a department or organiza- 
tion, however, is an unrealistic assumption. 7 
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Make a clear and concise statement describing the employee's performance 
on each of the factors below. 

Productivity: Volume of work and major accomplishments 



Accuracy: Meeting quality standards 



Coordination: Planning and organizing work and supervising employees 



Fi£t. c 3.3. Essay Appraisal Format 
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Cooperation: Working relationships with others 



Know-how: Possession of job-related knowledges and skills 



Development: Personal strengths and areas needing improvement. 



Figure 3.3. Essay Appraisal Format (Continued) 
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Consider the employees in your department in terms of overall jcb performance 
Select the best employee and put his/her name in column A. line 1 Then 
select the worst employee and put his/her name in column B, line 20 Continue 
this process until the names of all employees have been place on the scale 


Column A (Best) 


Column B (Worst) 


1. Warren Clark 


11 


2 Sam Burton 


12 


3. James Strawn 


13 


4 Deborah Stirsson 


14 


5 William Buford 


15 


6 


16 Wilson Fowler 


7 


17 Sylvia Watt 


8 18 Harry Larkin 


9 


19 Robert Lee 


10 


20 John McCord 





Figure 3 4 Ranking Scale Using Alternative Ranking Method 

Source Adapted from Dale Yoder, Personnel Management and Industrial Relations (Englewood Cliffs Prentice 
Hall, 1970) p. 237 



Persons 
Rated 


As compared to: 


[SCORE 


RANK 


SB 


WB 


wc 


WF 


HL 


RL 


JM 


DS 


JS 


sw 


Sam Burton 




X 




X 


X 


X 


X 


X 


X 


X 


8 


2 


William Buford 








X 


X 


X 


X 






X 


5 


5 


Warren Clark 


X 


X 




X 


X 


X 


X 


X 


X 


X 


9 


1 


William Fowlei 










X 


X 


X 






X 


4 


6 


Harry Larkin 














X 


X 






2 


8 


Robert Lee 
















X 






1 


9 


John McCord 






















0 


10 


Debc ah Stinson 




X 




X 


X 


X 


X 






X 


6 


4 


James Strawn 




X 




X 


X 


X 


X 


X 




X 


7 


3 


Sylvia Watt 










X 


X 


X 








3 


7 



Note X means that the person s performance is better than the peison with whom he/she was paired 
For example, Clark's performance is better than any of the uthers Lee s is only better than McCord's 
Figure 3,5. Ranking With Paired Comparison 
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Instructions. Assign the employees in your department to the appropriate 
categories using the following distribution as a guide 



Outstanding 
(10%) 

W. Clark 



Above 
Average 
(20%) 

S. Burton 
J Strawn 



Average 
(40%) 

D Stmson 
W Buford 
W Fowler 
S Watt 



Below 
Average 
(20%) 

H Larkin 
R Lee 



Un- 
satisfactory 
(10%) 

J McCord 



Figure 3 6. Forced Distribution 



Another problem with all comparative methods is that individuals are usually com- 
pared in terms of overall job performance. This kind of comparison limits the useful- 
ness of the appraisal for providing feedback to the individual regarding aspects of job 
performance which are acceptable and those whieh need improvement. 8 Therefore, the 
results of comparative methods are likely to be meaningless and may be damaging to 
morale since someone must be last. To illustrate how ranking methods distort reality, 
consider that there is a slowest runner on the U.S. Olympic' gold medal 4 x 100 relay 
team and a fastest runner among 45 to 55 year old finishers in a local M fun run." 
Comparative methods are not job . Jated and thus are difficult to validate. 

One point can be made in defense of comparative methods. An organization may 
need to determine rankings for administrative purposes, such as a validity check on 
another method. A supervisor who has rated 10 individuals on a graphic rating scale 
may be asked later to list the individuals ftor.i first to last in order of performance. A 
strong positive rank correlation would be expected. 
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Checklist Methods 

A checklist method known as forced choice was developed b> the U.S. Army dur- 
ing World War II to overcome the problem of lenient performance rating*. Although 
there are a number of variations, the procedure usuall) requires raters to select from a 
group of statements tho^e that are related to the individual's behavior. A group of 
statements is shown in Figure 3.7. 



From each group of statements below, mark M beside the statement which 
is most descriptive of the employee's behavior and mark L beside the 
statement which is least descriptive. 

A, Inclined to avoid responsibility 

Takes pride in the job 

Shows poor leadership 

Open to suggestions. 

B. Exercises good judgement 

Tends to resist change 

Treats subordinates with respect 

Has gaps in job knowledge 

C Fails to establish priorities 

Complies with policies and procedures. 

Pays attention to details. 

Does not meet deadlines 



Figure 3.7. Forced Choice Appraisal 



The rater is required to pick one statement that is most descriptive and one that is 
least descriptive of the individual. The statements are deigned so that only one of the 
favorable and one of the unfavorable statements is associated with job performance. 
This information is not provided to the rater, thus, the results of the rating are known 
only to the personnel department, which has the key. This kind of rating tends to be 
resented by both managers and ; ndividuals, and feedback is obviously impossible. 
There are also serious questions as to whether it is possible to develop a set of state- 
ments that distinguish between good and poor performers. 
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Critical Incidents 

Critical incidents are reports made b\ knov ledge able observers of a< tion taken Dy 
individuals who were especiall) effective or neffective in accomplishing their jobs. 
The critical incident technique, or CIT, was developed in 1954 by John C. Flanagan.* 
Critical incidents are recorded by superiors as the} happen, thus are short and to the 
point, and they normally consist of a single sentence. The following are examples of 
critical incidents that illustrate effective performance: 

• Conducted fonnal review sessions outside regular class hours, scheduled 
sessions so that maximum number of students could attend (Instructor). 

• Developed reading list of materials contained in library to support course objec- 
tives; keyed material to textbook (Instructor). 

• Prepared for and conducted class when instructor was hospitalized unexpect- 
edly. Covered all scheduled material for 2-week period (Division Chair). 

Critical incidents also describe ineffective or poor performance such as the fol- 
lowing: 

• Was absent from scheduled class without legitimate reamn and with no notice to, 
students (Instructor). 

• Made several errors in computing students' final grades, resulting in complaints 
to Dean and reissuing of grade reports by registrar (Instructor). 

• Failed to hold performance appraisal conference with faculty member (Division 
Chair). 

Critical incidents provide useful information,, particularly when they arc collected 
and placed in appropriate categories. For example, an instructor whose critical inci- 
dents reveal a pattern of innovation, such as developing a reading list, might be consid- 
ered for a promotion to a position where this characteristic could be utilized more fully. 
The main disadvantage* of the critical incident technique is that it is time-consuming 
and burdensome and it may be neglected by supervisors.!** 

Performance Standards 

Performance standards require a list of conditions that will exist when a job is 
being performed well. Man) organizations have implied performance standards, but 
these are not spelled out in accordance with job duties. In a fonnal system using 
performance standards, a job analysis is conducted that results in a job description 
setting forth w hat is to be done. Performance standards desenbe how much is expected 
or how well the duties are to be perfonned. Figure 3.8 provides an example of perfor- 
mance standards for an instructional position, in the dimension of "Instruction". 



ERIC ^kj 



30 Performance Appraisal 



1 Schedule and Attendance 'Arts Uasst-s as s . ►vduK-d Lru uuraues attendance 
throughout the quarter Rocurds daily c ittcMHlaru v V< rts uassrs tor full time punod 
Is cooperative regarding teaching assignments 

2 Method of lnstruct ; on Var.es method of presentation ' ru rt student interest 
Uses class time on subject matter Lruourages student part-cipat'un Demonstrates 
overall knowk dge of sub)uct and presents material so that it is understood Oy students 
Encourages students to seek h«>ip after class if needrj 

3 Presentation of Instruction Presents nturmat'ur Mu^nt'y and preo-seiy and 
stimulates stud' nts interest Attempts l> make -nbtruct'on a pkasant experience for 
students 

4 Student Evaluation Administers student evaluations avoiding to established 
procedures Reviews results and uses Vedbac k to 'mpro\." teat hmq 



Figure 3 8. Performance Standards itt Instructional Position 



Standards should be established through negotiations between the individual or 
group of subordinates and the superior. Advocates of performance standards recom- 
mend that they be written in quantitative terms when possible. However, as the exam- 
ples show, some job aspects are difficult to reduce to quantitative terms, therefore, 
behavioral statements must be made. 

The advantages and disadvantages of the performance standards approach are as 
follows: n 

The participative approach gives both the subordinate and the superior a means of 
sharing thoughts about work priorities and expected results. This approach tends to 
earn the subordinate's commitment to achieve standards and the supenor's commitment 
to provide support and resources, The subordinate is not surprised b> the appraisal 
results, standards arc known all along so the subordinate can identif) iaiy variances as 
they develop and correct the problem before the formal appraisal. Appraisals and feed- 
back interviews are more objective and less contentious because the) are based on 
specified outcomes in the principal job segments rather than on personality traits. 

The principal disadvantage of the performance standards approach is the amount of 
time and thought required to discuss job priorities and develop standards foi ail the sig- 
nificant ^cgmcvts of each job It takes effort to agree on performance standards and 
define them in eh ar and measurable terms. Although time is difficult to schedule, it is 
time well spent iuis process requires dun..nistrators to identify, describe, and weigh 
the various job objectives and results. 
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Behavioral Scales 

The behaviorally-based instrument most frequentl> recommended by industrial 
psychologists is the behaviorally anchored rating scale (BARS). This scale was origi- 
nally referred to in the iiterature as the behavioral expectation scale (BES), and the two 
terms are used interchangeably. 1 - 

The construction of BARS generally follows procedures developed by Smith and 
Kendall. 15 The first step is to collect critical incidents that describe a wide range of 
behavior and place them in broad categories (e.g., planning, testing and evaluation, 
instruction, etc.). Each category serves as one performance dimension for appraising an 
individual. A group of people with knowledge of the job are given the set of critical 
incidents and categories. Members of the group are asked to match each incident to the 
category they believe the incident illustrates. This procedure u known as retranslation. 
Incidents that are not a< igned to the same category by a high percentage of the group 
and those that fall frequently into two or more categories are discarded. Another group 
of people also familiar with the job are given the final categorized list of incidents and 
are asked to rate each incident on a five to nine point scale, representing a continuum of 
job performance from outstanding io poor. The only items retained are those on which 
there is much agreement. These incidents arc used as anchors on the rating scale, hence 
the term behaviorally anchored. The value given to each incident is the mean value 
assigned by the group. An example of BARS for the position of instructor is shown in 
Figure 3.9. 



5 O0---Professor can be expected to vary syllabus of class to fit students' background. 
Emphasis would be placed on projects and discussion rather than lectu.,;. 
Grading is besed on quality of projects and tests 

4 O0---Professor can be expected to meet all classes, to add the lecture with current 
materials, to answer course material throughly, and present a variety of test 
methods 

3 O0---Professor can be expected to meet all classes, then deliver organized i?^t-ies 
with appropriate standardized testing devices. 

2 00---Professor can be expected to meet almost all classes and to closely repeat 
text, paying little attention to outside material or student questions 

1 00-- Professoi can be expected to hold classes irregularly. Also can be expected 
to present "true life" examples frequently which have little relationship to course 
material. 



Figure 3 9 A Behaviorally Anchored Rating Scale lor the Dimension "Classroom Teaching Performance" 

Souice Robert D Gatewood and Hubert S Feild. Human Resource Selection. (New York Dryder Press. 1987). p 505 
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While BARS is highly job-related, there are several limitations. The most obvious 
problem is that the rater may not be able to match observed behaviors with the scale 
anchors. 14 There are obviously many more critical incidents which describe perfor- 
mance under the domain of "Classroom Teaching Performance" than the five items 
which are provided on the scale. Another problem is that the rater might observe both 
"good" and "bad" performance on the same dimension. For example, the faculty 
member might meet all classes, but during the same period present "true life" examples 
in class which frequently have little relationship to course material. 

A procedure which overcomes these and other limitations of BARS ts called 
behavioral observation scales (BOS) as set forth b> Latham and We\levJ r The primary 
difference is that BOS is developed by attaching a 5-point Likert scale to identify each 
behavioral item as shown in Figure 3.10 for the job dimension of "Instruction". 



Begins class on time 

Almost Never 1 2 3 4 5 Almost Always 

Follows lesson plan 

Almost Never 1 2 3 4 5 Almost Always 

Uses class time on subject matter 

Almost Never 1 2 3 4 5 Almost Always 

Encourages student participation 

Almost Never 1 2 3 4 5 Almost Always 

Provides outlines, handouts, and bibliographies to students 

Almos* Never 1 2 3 4 5 Almost Always 

Emphasizes topics of maior importance 

Almost Never 1 2 3 4 5 Almost Always 

Summarizes presentation 

Almost Never 1 2 3 4 5 Almost Always 

Provides time for student questions 

Almost Never 1 2 3 4 5 Almost Always 



Figure 3.10. Behavioral Observation Scales for the Job Dimension ol 'Instruction* 



Considerations in Selecting 33 



The major advantage of BOS is that raters are forced to make a more complete 
appraisal of the individual's performance, rather than emphasizing only those items 
which they can recall at the time of the rating and are able to match with one of the 
scale anchors. 

A final type of behavioral scale, which is less rigorous than BARS or BOS, is an 
expansion of the performance standards approach. This type of scale attempts to 
answer such questions as "How good is exceptional?" or "How bad is unsatisfactory?" 
The scale is constructed by considering task statements developed by job analysis and 
writing statements which describe levels of performance in each job dimension. The 
number of levels of performance depends on the number of scale points. The underly- 
ing assumption is that for each job dimension, all tasks in the dimension will be per- 
formed in the same general way. The rater selects the description which "best fits." An 
example of this approach for the dimension of instructional preparation is shown in 
Figure 3.11. 

Behaviorally based scales have several general advantages over other methods. 
Superiors and subordinates usually are involved in their development. The feedback 
provided is highly job-related, and performance appraisal sessions focus on behavior 
that contributes to successful j.a> performance. There are disadvantages to these 
methods. BARS in particular is cxtremel) complex, requires sophisticated statistical 
analysis, and is time-consuming. The development procedures for these appn isal 
instruments musi be repeated for each job, which ma> not be cost-effective for .nose 
organizations that have a wide vanch of jobs and have onlv a few individuals J each 
category. 



Management by Objectives 

Although the comparison of results achieved against plans has alwa>s been used by 
managers, Management b> Objectives (MBO) was fust proposed by Peter Drucker in 
1954J* As a formal pe formance appraisal s>stem, MBO consists of the following 
steps: 17 

1. Organizational goals are established during the planning process and 
commitment to these goals is established at all managerial levels. 

2. The key results areas of the job are identified. These are highly selective areas 
in which the subordinate must achieve an acceptable level of performance to be 
successful. 

3 The superior and subordinate iiuiumII) agree o.i several objectives within key 
results areas that coincide with or support orgi'iiuational or departmental goals. Perfor- 
mance requirements and timetables arc established and the .subordinate is allocated the 
necessary resources. 
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METHOD OF INSTRUCTION - Presenting letters, demonstration, or laboratory supervision, 
using appropriate method of instruction and resources, providing out-of-class assistance 
when necessary. 


EXCEPTIONAL 


0 


Uses a variety of methods, aids, and/ or resource people as 
part of presentation, encouraging student involvement. 
Demonstrates comprehensive and in-depth knowledge in 
subject area. Stimulates and maintains student interest. 
Exhibits openness to ideas of students. Is enthusiastic about 
subject, students, and teaching 


VERY GOOD 


□ 

i — i 


Uses a variety of methods and aids to increase students' 
interest. Exhibits substantial knowledge in subject area. 
Provides outlines, handouts, and bibliographies to aid 
learning. Involves students in presentation. Wisely uses class 
time. Directly offers outside help to specific students 
determined to need it. 


ACCEPTABLE 


s 


Varies method of presentation to increase student interest. 
Uses class time on subject matter. Encourages student 
participation. Demonstrates overall knowledge of subject and 
presents material so that it is understood by student. 
Encourages students to seek help after class if needed. 


MARGINAL 


0 

i j 


Presents essential information. May use same method of 
presentation daily. Demonstrates basic knowledge in subject 
area. Answers student questions, but does not involve them 
in presentation. Is available for outside help when needed. 


UNACCEPTABLE 


□ 


Uses class time poorly— strays from subject. Is not available 
for help outside class. Does not demonstrate adequate 
knowledge in subject area Does not encourage student 
participation. 



Figure 3 11 Example of a behavioral scale based on expanding the performance standard for Method 
of Instruction/' The scale is not behaviorally anchored. 
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4. The superior and subordinate hold interim progress reviews. These reviews 
provide feedback to the subordinate and ma> involve corrective action needed to stay 
on target or revisions of objectives in the face of unforeseen problems. 

5. At the end of the period, actual accomplishments are measured against ptnor- 
mance requirements, and objectives for the next period are established. 

For MBO to be effective, a distinction must be made between objectives in and 
performance requirements. Unless this distinction is made there probably will be no 
basis for determining if the objective was accomplished. Figure 3.12 illustrates this 
point: 



Position 


Objective 


Requirements 


Instructor 


Improve testing and 
evaluation procedures 


Submit list of 20 
questions for departmental 
examination by May 1 


Division Chair 


Develop writing skills 
oi freshman students 


Establish and staff 
a writing skills 
laboratory 


Dean 


Project positive image 
of college to community 


Present program to 
five civic clubs 
during year 



Figure 3 12 Objectives and Performance Requirements 



MBO has many attractive features and is especially appropriate for management 
positions. Performance appraisals are job-related because the objectives define the 
most important aspects of job performance. Where factors are subjective, the personal- 
ity of a manager or subordinate may influence judgments. In some cases the superior 
may have difficulty explaining to the subordinate a discrepancy between objectives 
previously agreed upon and result* attained. Should this happen, discussions must be 
held by the two parties until a mutual understanding is reached. These discussions can 
focus on problems, ways to improve, and assistance needed. 

Like other appraisal systems, MBO has its disadvantages. Emphasis is placed pri- 
marily on tangible results that are easily measured. Consequently, there is often a 
failure to appraise important aspects of the job that cannot be explained or measured in 
quantitative terms. Even when such measures can be obtained, an individual's perfor- 
mance usually is affected by factors beyond his/her control. The exclusive use of MBO 
can hinder cooperation by encouraging a result-at-all-costs mentality that decreases the 
overall productivity of the organization. i« Finally, performance outcomes alone do not 
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tell individuals what they need to do to ir " .in or increase productivity. For example, 
telling the Division Chair that the writing skills laboratory is not in operation will not 
come as a surprise. He/she needs to know what must be done to achieve the desired 
result and how the organization can help. Possibl> budget cutbacks have resulted in 
insufficient funds to hire lab instructors, or sufficient space ha* not been made avail- 
able. Problems such as these are why man> authorities emphasize the need to combine 
MBO with other measures of job behavior. 19 

Sources of Appraisal Data 

The best sources of appraisal data are. (1) a knowledgeable individual who has 
directly and continually observed job performance and who tan rate performance with- 
out error or bias and (2) items that can be counted, qualified, measured, analyzed, or 
compared, These factors should be considered no matter which approach is .selected for 
conducting the performance appraisal. This section provides a brief description of the 
various sources which are currently accepted within organizations. Sources of critical 
information needed to perform the appraisal function may include, the supervisor, the 
subordinate, peer review, self-appraisal, and outside appraisals (including the assess- 
ment center concept and student evaluations, where applicable). 20 

Supervisor Appraisal 

Probably the most important source of judgmental data is the immediate superior. 
A manager has both a right and a duty to make appraisal and developmental decisions 
regarding subordinates. In addition, the superior normally assigns the work and is 
responsible for rewards and sanctions. The liabilities of supervisory appraisal include 
the familiar objection to "playing God" as well as the lack of interpersonal skills needed 
to maintain positive relationships with subordinates. Moreover, there is always the 
possibility of rater errors, including favoritism and bias. 

Subordinate Appraisal 

Appraisal by subordinates is the opposite of supervisory appraisal and the advan- 
tages and disadvantages are reversed. The major advantage is that such appraisals are 
highly democratic and they encourage participative management. This ty pe of appraisal 
is often seen as illegitimate because it undermines the superior's rightful authority. 
Also a superior is already being appraised by subordinates, albeit indirectly. The 
superior's rating is usually influenced by how well or poorly the subordinates perform 
their work. 



Peer Appraisal 

Peer appraisals are most effective w hen there is a high level of trust among peers 
and when job performance information is available to peers such as in a fatuity. 

O 
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Research has shown that peer appraisals are strongly conclatcd with objective measures 
of job success, However, peer appraisals ha\e a competitive aspect and can be disrup- 
tive Conflicts ma> arise between making objective appraisals and maintaining colle- 
gia! relationships. Finally peers may agree in advance to give each other high ratings. 

Self-Appraisal 

Self-appraisals may be justified when the individual is in the best position to judge 
his/her own performance, such as in the ease of ph>sical isolation or when the individ- 
ual possesses a unique skill or ability. Self-appraisals are useful in development 
because they emphasize personal growth, intrinsic motivation, and goal-setting. They 
also communicate to the superior how the subordinate perceives his/her performance 
and provide insights not otherwise available However, self-appraisal.s are often poorly 
correlated with supervisory appraisals and are unreliable as a single source of informa- 
tion for promotions and merit pay. 

Appraisal by Outsiders 

Appraisal by outsiders is based on the need for someone with specialized expertise 
but without a vested interest in the appraisal results. Examples are retaining a C.P.A. 
firm to conduct an audit of a financial statement or a visit by an accreditation team. 
Another application is known as an assessment center where candidates for managerial 
positions participate in a variety of situational exercises and are assessed by several 
trained observers on their performance. Another type of appraisal by outsiders is 
student evaluation of teaching performance, although the assumptions of specialized 
expertise and lack of a vested interest do not hold. There is evidence in the literature 
that suggests that students ma> sometimes be unable to discriminate between effective 
and ineffective teaching.^ Moreover, many faculty members hold somewhat cynical 
opinions concerning the value of student judgments. Nevertheless, these ratings, when 
properly evaluated, are a useful source of appraisal data. 

In regard to objective data, the variety of measures is so large that it is impossible 
to categorize them completely. For faculty members the list might include publications, 
reading lists, community service projects, student clubs, activity reports, test gains, 
student performance in subsequent courses or other institutions,, and the like. For 
administrators there are accreditation studies, contracts and grants, budgetary increases, 
management audits, and similar measures. Analogous examples could be cited for 
support personnel. 

Organizational practice and empirical evidence suggest that the appraisal process 
should normally be conducted b> the immediate superior who can integrate both judg- 
mental and quantitative measures. The problems of this approach can be solved by 
developing a job-related system and by properly training raters. For example, in rating 
an instructor on the dimension of classroom teaching, the department chair might con- 
sider the following: 
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• Report of a faculty peer review committee 

• Analysis of student evaluations 

• Recognitions such as testimonials and teaching awards 

• Syllabi, manuals, reading lists, and other teaching aids 

• Personal observation of classroom performance 

• Enrollment and subsequent course performance data 

• The instructor's self appraisal 

Note that this list includes both judgmental and objective data from a variety of 
sources. % In rating a different dimension,, for example, scholar!) productivity,, the 
department chair would develop sources of data which reveal qualit), creativity, and 
significance of the contributions of the professional field. 

Cost Considerations 

Developing, validating, and administering a performance appraisal s>stem is a 
major undertaking and requires a substantial investment in time and money. There are 
a number of factors an organization should consider m making the decision regarding 
resources to be invested. Among these are the nature of the relationship between devel- 
opmental costs and system effectiveness, allocation of costs among patrons, and 
potential for improving performance. 

In general, the more costs the organization is willing to incur,, the better the system 
that can be developed. It is important to note, however, that as more is invested in 
development beyond what is necessary to establish validity, incremental costs do not 
necessarily result in propoitionate increases in system effectiveness. An example 
would be useful to show this relationship. Assume the objective is to measure the per- 
formance of a faculty member. A dimensionahzed and weighted rating scale similar to 
Figure 3.2 could be developed, Based on the author's experience, the job analysis, 
criterion development, and instrumentation could be accomplished for under $2,000 and 
would meet the minimum requirements of the "Guidelines." It might be desired, how- 
ever, to develop behaviorally anchored rating scales similar to Figure 3.7. The devel- 
opment of BARS requires a much more sophisticated approach and the cost could be as 
high as $10,000. While the cost may be five times as high, there is no research which 
suggests that BARS is five times more accurate. In fact, reviews have not found BARS 
to produce substantially more accurate results than traditional graphic scales.^ The 
same relationship holds true in the administration of a performance appraisal program. 
The essential elements of such a program include appraisal interviews, and an appeal 
process. The cost is considerable, and there is always the danger that both subordinates 
and superiors may spend more time and energy in various aspects of appraisal than in 
productive work. While certain administrative requirements are necessary, they should 
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be kept in perspective. Beyond the point necessarv to ensure that the appraisal program 
is carried out under standardized and controlled conditions, additional meetings, paper- 
work and procedures do not justify the cost. In other words, the investment in both 
development and administration of performance appraisal is subject to diminishing 
returns. 

Another important consideration in the investment decision is the number of 
incumbents in a particular job category. For example, an institution might have 100 
instructional positions and two library technicians. Assume that there are three instruc- 
tional divisions: e.g., Arts and Humanities, Science and Mathematics, and Nursing. 
Within each division the instructional positions are fundamentally similar. Thus, the 
developmental cost of a performance appraisal technique could be spread across 20 to 
50 positions in the faculty, but only two in the library. This would support a decision to 
develop a more sophisticated (and expensive) svstem for the faculty than for the library 
and other support departments. 

Finally, it is very important to consider the value of post-appraisal benefits in such 
areas as increased productivity, motivation and satisfaction, staff development, and 
better administrative decisions. This may be intuitively obvious, but the implications 
are sometimes overlooked. Thomas F. Gilbert has introduced the concept of potential 
for improving performance (PIP), which is the ratio of exemplary performance to typi- 
cal performance.^ A PIP of 5.0 suggests that typical performance could be improved 
fivefold, while a PIP of 1.1 tells us that exemplary performance is only 10 percent better 
than typical performance. Gilbert suggests that in professional athletics PIP's almost 
invariably run less than 2 and exceptional!) competitive and demanding jobs such as 
that of an airline pilot have PIP's near K On the other hand, PIP's in education and 
government are typically 5 to 30, showing much more potential benefits from per- 
formance appraisal. 



Concluding Comment 

It should be stressed that there is no one best way to go about selecting a perfor- 
mance appraisal technique. Performance appraisal programs serve many purposes, and 
most of the techniques discussed have valid applications. Organizations may want to 
eliminate options such as tiait rating scales that have serious disadvantages. Several 
alternatives to the traditional superior-subordinate appraisal review function have been 
described in this chapter. Organizations may choose to incorporate various sources of 
information into their overall employee performance appraisal process. They also need 
to carefully analyze appraisal costs vs. benefits. The methodology finally adopted may 
be a mixed system with features of several techniques. 
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Development of Performance Appraisal and 

Accompanying Criteria 

Edith A. Miller 



The development of an appropriate performance appraisal procedure and its 
accompanying criteria is a complex set of tasks. While there is a vast body of theory 
and research related to performance appraisal methodology, there is also an equally 
extensive and widely differing range of opinion, research, and suggestion in the litera- 
ture regarding not only performance appraisal generally but also criterion development 
specifically. While there is no concensus regarding the right or best instrument or the 
most appropriate criterion, it Is clear that whatever form a performance appraisal system 
takes it must be: 

1. Conceptually or philosophically congruent with the job, profession, or con- 
stellation of duties and responsibilities it is designed to appraise. 

2. Directly related to the actual day-to-day, on-the-job, performance of these 
duties and responsibilities. 

3. Usable and legally defensible. 

4. A source of information for improvement (growth) of the individual being 
assessed as well as improvement or added benefits for the institution or orga- 
nization in which the individual is employed. 

5. Sound from a measurement point-of-view-that is, valid and reliable. 

The first four characteristics herein listed are cleaily related to a cogent under- 
standing of the job or position to be appraised Klasson, Thompson, and Luben outlined 
four important qualities a performance appraisal system must include to be defensible. 
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1. The performance appraisal system should be formally developed, thoroughly 
documented, and as objective as possible 

2 The standards of performance for all positions being appraised must be based 
on the results of a thorough, format job analysis. 

3. Relevant job dimensions and desired job performance should be reflected in 
each performance standard. 

4. The appraisal process should involve the measurement of performance with 
the weighting of each dimension or criterion fixed prior to the utilization of the 
appraisal system, i 

Throughout these qualities is found the notion that the performance appraisal pro- 
cedure is inextricably linked to the nature of the job or performance being appraised. 
The preferred method for assuring that the performance appraisal is not only conceptu- 
ally and philosophically congruent but also directly related to the actual performance 
being appraised is some form of job or task analysis. The first section of this chapter 
will address job analysis as it serves as the basis for the development of the overall per- 
formance appraisal system and most specifically for the development of the evaluative 
criteria with which the system operates. Issues surrounding the choice, adaptation, 
and/or development of a performance appraisal sysiem will be explored in the second 
section of the chapter Specific measurement issr;s regarding performance appraisal 
with specific attention to reliability and validity as well as sources of error will con- 
clude this chapter. 



Job Analysis 

The issue of job analysis is as central to the development of tests, performance 
appraisals, and evaluation procedures as it is to the development of management strate- 
gies. Ghorpode defined job analysis as . . a managerial activity directed at gathering, 
analyzing, and synthesizing information about jobs.^ Lopez. Kesselman, and Lopez 
indicated that from the time it began to assume importance in the test construction 
^ocess, job analysis had also begun to play an important role in personnel selectiori.3 

Both the process and outcome of job analysis are essential to the development of a 
performance appraisal system. Not only does the job analysis info' mtion serve as *\e 
base for the development of the "items" oi "behaviors" or "traits" to be appiaised but 
also a well designed and executed job analysis will contribute to cu^non development 
and content validation. Moreover, it was shown in Chapter 2 that job analysis has com- 
pelling legal implications. 

The job analysis procedure is in itself a complex and demanding aspect of the 
development of a performance appraisal system. Prion strongly stated that job analysis 
is not an easy job that just "anybody" can do.* Rather it is a step that requires much 
thorough planning and careful execution. He further indicated that while the research 
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on job analysis techniques has indeed grown beyond its infancy, there is still not a 
strong body of research to answer the question of what is the best job analysis proce- 
dure to use in specific situations. < In Principles for the Validation and Use of 
Personnel Selection Procedures, the following statement is made that, "There is 
currently no authoritative set of principles for job analysis comparable to the Standards 
or Principles in the area of selection procedures."* The document continued by noting 
some specific things that a job analysis must do. (1) specify the descriptor* or units of 
analysis by which the job will be defined, (2) develop task or activity statements for 
job-oriented analyses, and (3) develop behavioral statements or descriptors for worker- 
oriented analyses. 

The categorization of job analyses into job-onented and worker-oriented is very 
useful There are literally dozens of published job analysis procedures. Bemis, 
Belensky, and Soder reviewed ten such systems as bases for developing a system which 
draws on both job-oriented techniques and worker-oriented techniques-Versatile Job 
Analysis System (VERJAS)7 The systems discussed by the authors range from the 
widely-used and generally well respected Department of Labor (DOL) procedure to the 
Guidelines Oriented Job Analysis (GOJA) which was developed specifically in 
response to legal and regulatory requirements. 

To discuss a wide variety of these job analysis procedures goes well beyond the 
scope of this document. However, it is impoitant to have an understanding of the ways 
in which the job-oriented and worker-or. nted niudels differ. Ghorpode stated that 
job-onented models tend to draw on the system framework for their definition.* The 
analysis of a specific job is seen as the analysis of a sub-unit of the organization. 
Sidney Fine's Functional Job Analysis (FJA) is a good example of this particular 
model Worker-oriented systems rest on preconceptions about the nature of the inter- 
relations between the aspects of the job and the individual m that position. The Position 
Analysis Questionnaire (PAQ) is a good example of worker-oriented model. To 
explore the differences between these two approaches to job analyses, the FJA and the 
PAQ will be examined in more detail Because of the importance of legal considera- 
tions, a brief discussion of GOJA will also be presented. 

Sidney Fine's Functional Job Analysis, developed during and after World War IL 
rests on a "systematically articulated theory of jobs and people": 1 * 

1. A fundamental distinction must be made between what gets done and what 
workers do to get things done. 

2. What workers do, insofar as job content is concerned, the> do in relation to 
three primitives: things, data, and people. 

3. In relation to each primitive, workers function in unique ways. Thus, in rela- 
tion to things, workers draw on physical resources, in relation to data, on 
mental resources; and in relation to people, on interpersonal resources. 

4. Aii jobs require the worker to relate to each of these primitives in some degree. 
O r 
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5. Although the behavior of workers or the tasks performed b> them can appar- 
ently be described in an infinite number of wa>s, there are only a small number 
of definitive functions involved, thus, in interacting with machines, workers 
function to feed, tend, operate, or set up, and in the case of vehicles or related 
machines, to drive-control them. Although each of these functions occurs over 
a range of difficulty and content, essentiall> each draws on a relatively narrow 
and specific range of similar kinds and degrees of worker characteristics and 
qualifications for effective performance. 

6. The functions appropriate to each primitive are hierarchical and ordinal, pro- 
ceeding from the simple to the complex. Thus, to indicate a particular func- 
tion, compiling (data), for example, as reflecting the requirements of a job is to 
say that it incluues the requirements of lower functions such as comparing and 
excludes the requirement of higher functions such as analyzing. 

7. The three hierarchies provide two measures for a job. Level is a measure of 
relative complexity in relation to things, to data, and to people. Orientation is 
a measure of relative (proportional) involvement with things, data, and people. 

8. The hierarchies of functions reflect a piogression from much prescription and 
little discretion in worker instruction at the least complex level to much dis- 
cretion and little prescription at the most complex level. 

9. Human performance is conceived as involving three types of skills, adaptive, 
functional, and specific content. Adaptive skills are those competencies that 
emble an individual to manage the demands for conformity and/or change in 
relation to the physical, interpersonal, and organizational arrangements and 
conditions in which tht job exists. Functional skills are those competencies 
that enable an individual to relate to things, data, and people (orientation) in 
some combination according to personal preferences and to come degree of 
complexity appropriate to abilities (level). Specific content skills are those 
competencies that enable an individual to perform a specific job accor 
standards required to satisfy the market. 10 



The Position Analysis Questionnaire (PAQ) was specifically designed to be a 
worker-oriented model. Developed by Ernest J. M^Cormick and his associates at 
Purdue University, the PAQ is based on the following undeil>ing assumption. 

If there is some such underlying behavioral structure, such structure presum- 
ably would have to be characterized in terms of the mainei in which more 
specific "units" of job-related variables tend to be organized uuoss jobs. Thus, 
the "building blocks" or common denominators or any dimensional structure 
must consist of relatively unitary, discrete job variables of some class that can 
be identified and quantified as they relate to individual jobs. 11 

i *i inventory of "job elements" within major divisions and subdivisions is then 
proposed in the PAQ. Within these divisions the inventor) of job elements serve as a 
basis for determining the behav loral dimensions of jobs. These dimensions include. (1) 
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information input, (2) mental processes, (?) work output, (4) relationships with other 
persons, (5) job context, and (6) other job characteristics. In regard to job context or the 
physical or social contexts in which the work occurs, examples of job elements would 
be high temperature and interpersonal conflict situations. 

A method which specifically addresses the requirements of the "Uniform Guide- 
lines" is known as GOJA, an acronym for Guidelines Oriented Job Analysis.^ This 
method, developed in 1974 by Richard E. Biddle, has been periodically refined and 
updated and has been successfully used with numerous public and private employees. 

When implemented in its entirety, GOJA is a multistep process which results in a 
selection plan. For purposes of performance appraisal the earlier steps of the process 
deal with the identification and characteristics of job duties as shown below: 

1 . Collection preliminary job data. 

2. Identify major job duties. 

3. Rate each duty by frequency and importance. 

4. Cluster related duties into job domains. 

These steps represent about one-half of the GOJA process; however, they provide 
the foundation on which a performance appraisal system can be built. GOJA is one of 
the ftw methods available that systematically takes a user from the content of a job to 
the content of a performance appraisal instrument. GOJA'; thoroughness in application 
and documentation makes it an important and useful method.^ 

These rather disparate examples of job analysis procedures should make the point 
that one must very carefully design the specific job analysis to meet the purposes to 
which the resulting data will be applied. The APA Principle suggested that job analy- 
sis procedures ". . be chosen or developed as it is appropriate to obtain iob information 
for the purposes or application of that job analysis information."^ pearlman suggested 

an examination of the research and conceptual issues in the area before choosing an 
approach J 5 

Ghorpode indicated tnat from the more job-oriented approaches one would get 
information about job outputs, guidelines, controls, tasks, and other job factors.^ With 
the more worker-oriented systems, information about aptitudes, abilities, and other 
human characteristics would emerge. The degree to which the appraisal system is 
designed to focus on these two dimensions of job analysis will direct the nature of the 
procedure. Just as the job analysis procedure can be oriented toward the job or the 
worker, it can also be oriented toward qualitative or quantitative data. The range of 
data gathered in job analyses extends from truly narrative, anecdotal records to highly 
quantitative data that can He totally analyzed with a computer. Again, the design of the 
job analysis will determine the kind of data gathered. 
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Development Issues 

A variety of development issues arises when one considers either adopting, adapt- 
ing, or developing a performance appraisal procedure. The first and most important of 
these issues is the determination of the purpose of the appraisal procedure -the use of 
the resulting data. If the purpose of proceuure is to make large-scale summative, insti- 
tutional judgments, one's focus would be quite different than if the focus were to iden- 
tify strengths and weaknesses with a view toward employee growth «nd development. 
Each of these widely differing purposes and many purposes between these two exam- 
ples will serve to establish the frame-of-reference for the choice, adaptation, or devel- 
opment of a performance appraisal procedure. 

As indicated in regard to job analyses procedures, there is also no clearly superior 
approach to conducting performance appraisals. There is a vast amount of research and 
theory around the issue, and depending on one's purpose, some of the research can be 
helpful in choosing an approach. As an illustration for this discussion of development 
issues, the use of a rating scale approach to performance appraisal will be used. Rating 
scales have proved to be generally useful in performance appraisal, and depending on 
the nature and use of the scale have also proved to be reliable. A study by Dawes indi- 
cated that while most rating scales are non-representational, with appropriate directions 
a rating scale could be used reliably to measure a representation variable, heightJ 7 
Furthermore, rating scales have both ordinal and interval properties.^ 

The retranslation method has provided a useful approach to establishing rating 
scales with behavioral anchors. 10 The accuracy of a rating scale format will, of course, 
vary with the nature of the job or performance being appraised.^ 0 However, a variety of 
rating scale formats -Behavioral Expectation Scale (BES), Behaviorally Anchored 
Pxating Scale (BARS), and Behavioral Observation Scale (BOS)- is being used exten- 
sively and very appropriately in performance appraisal activity. 

In 1963, Maurice Lorr, C. James Klett, and Douglas McNair made five specific 
suggestions regarding the development of rating scales: 

1. Only one variable should be rated at a time. 

2. Several items covering an aspect of behavior or a trait should be included in a 
rating scale. 

3. Scales should allow the rater to describ: trie strength of a trait or behavior. 
Bipolar opposites are difficult to depend on for clear information. 

4. Items should use clear, non-jargon language as much as possible. 

5. The span of the scale should reflect the range expected in the population to be 
appraised.21 
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In discussing the construction of rating instruments for faeult) evaluation, Berk 
maintained that the characteristics of the instrument would evolve from four basic 
phases of the construction process: 

1 . Specification of the domain 

2. Scaling of the instrument. 

3. Item generation. 

4. Statistical analysis of the instrument" 

Domain specification is, of course, the identification of the "ballpark" of the 
appraisal development process. What skills, behaviors, performances, traits, abilities, 
qualities, aspects, etc. will the appraisal address? The development of the criteria 
(criterion) against which these aspects will be appraised is also of critical importance, 
Flanagan, in describing the critical incident technique of performance appraisal, 
suggested that the criteria for performance appraisal must come not only from qualified 
experts but also from descriptions of skilled professionals. The steps proposed by 
Flanagan included the following: 

1. Observation of the activity's purpose of aim. 

2. Specification of the observation methodology. 

3. Data collection. 

4. Analysis of observation data. 

5. Interpretation of resulting data to establish performance mteria.^ 

In the specification of the domain to be assessed, Berk suggested a procedure called 
facet analysis: "The task of the domain deemed important and worthy of measure- 
ment "24 The purpose of an appraisal system and the anticipated use of the resulting 
information will, of course, determine how general or specific this facet analysis must 
be. The developmental step which follows the identification of the facets of the domain 
is to translate them into a set of elements which identify the salient features of the 
performance to be appraised. Beik suggested a set of guidelines for the development of 
rating instruments - s Many of these points are dneetl) relevant to the development of a 
rating scale within a performance appraisal system. 

1. Specify the purposes of the evaluation (appiaisal) and the decisions to be made 
with the results. 

2. Define the domain of character istics to be measuied using facet analysis or a 
similar procedure. 
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3. Develop a summated rating scale continuum consistent with the types of 
characteristics to be rated. 

a. Intensity of scale is in Likert form of agreement/disagreement. 

b. Numerical format should be used rather than graphic when possible 
because of scoring or summing ease. 

c. Anchors of scale should be clearly defined. 

d. Five-point scale is adequate from the point of reliability. 

e. Neutral option on the scale can be used or not according to personal pref- 
erence. 

f. Non-applicable option should be used only for non-applicable items. 

4. Generate a pool of items to measure the characteristics. 

a. Two or three items per facet. 

b. Available rating instruments and banks serving as resource. 

c. Evaluating items for quality and congruence with domain specifications. 

5. Field-test the instrument and appraise the psychometric qualities of validity, 
reliability, item stability, etc. 

Using this general format suggested by Berk is a straightforward approach to ratmg 
scale development.^ Berk\s general steps, however, apply to the development of other 
appraisal measures as well. Once the rating scale, or checklist or inventory of tasks, has 
been developed, Berk suggested the following criteria for evaluating items 

Content/Format: 



1. 


Clear, direct, specific language. 


2. 


One complete thought or concept. 


3. 


Concise (no more than 20 words). 


4. 


Simple sentence. 


5. 


No universal words, e.g., all, always, none, never. 


6. 


No words like only, just, and merely. 


7. 


No jargon. 


Congruence with Specifications: 


8. 


Applicable to all being evaluated. 


9. 


A desirable characteristic. 



10. Congruent with facet element. 
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1 1. Consistent with anchors on rating scale. 

12. Factual or can be interpreted as factual. 

13. Open to only one interpretation. 

14. Likely to be responded to by all raters. 27 

Beyond these simple criteria against which to compare the items on the instrument 
itself, the items should also be compared against the scale to be used. Berk suggested a 
summated (Likert) scaled Other scales which might be considered include; paired 
comparisons, equal appearing intervals, successive intervals, scalogram analysis, 
semantic differential, Q-sort techniques, and multidimensional scaling. Some of these 
procedures have serious drawbacks regarding the reliability and validity of the resulting 
data-paired comparisons, for example. Again, the scale should be chosen in light of 
the intended use of the resulting data. The summated scale (Likert-type) does lend 
itself to statistical analyses that go beyond simple descriptive statistics. 

Once the domain has been specified drawing on-the-job analysis information, an 
instrument type and scale have been chosen, and items have been developed, the next 
consideration is the statistical analyses of the resulting data. There are two major 
arenas of statistical analyse", to be considered: (1) analyses of the data in the instrument 
development process and (2) the analysis of the resulting data for decision or staff 
development use. 

Three major types of analyses should be conducted at the instrument development 
stage: (1) intercorrelations of items, (2) study of variability and (3) factor analysis of 
the items and subscales to test for empirical verification of conceptual item develop- 
ment. 

The analysis of the resulting data depends on the kinds of decisions to be made 
with the data. There is much controversy about whether performance appraisal instru- 
ments should be one dimensional or should represent several dimensions. Again, the 
literature provides no clear-cut answer. However, Smith clearly indicated that ". . . 
when several dimensions are involved several sets of criteria as composites will be 
required/'^ Given the highly specific nature of performance appraisals, one answer to 
the question of one overall measure or a series of discrete measures is absolutely impos- 
sible. The anal> ses of these data would, of course, help in determining the relatedness 
or independence of the various dimensions of the instrument. 

Whether one adds all of the items into one scale or related items mto subscales, 
Fraliex and Raju found that the weighting of items need not be as difficult as once 
thought ™ In their stud} of 112 bankers, they found that Management Weights (MGR), 
Equal Weights (EQL), Unit Weights (UNIT), and Factor Weights (FaCT) produce 
highly comparable ratings. Equal weights derived by utilizing standard deviation recip- 
rocals and management weights achieved by having managers weight each item are 
considerably more time consuming than allowing cadi item to contribute equally to the 
sum. Likewise, factor analysis is more time-consuming and requires much more 
sophistication A fifth weighting procedure -canonical correlation -was also used in the 
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study, but those weighted results correlated roughl) at the zero level with the other 
weights. Because of the nature of canonical correlation, that particular result was 
expected by the researchers. 

Decisions made on the weighted, summed* or otherwise statistically or conceptu- 
ally treated data must be made bv those who designed the performance appraisal 
system. Standard setting and cut-scores, numbers of items at particular levels, and 
levels of performance required must be determined tn terms of local needs. One 
caution that all using performance appraisal instruments must heed, however, is that 
many of the traits, behaviors, attributes, aptitudes, etc. that are being appraised are not 
parallel either in importance or in ease of measurement or observation. These consider- 
ations must be attended to in any performance appraisal approach. 

Measurement Considerations 

The pnrrar> measurement considerations which come to mind when focusing on 
performance appraisal are those of validit) and rehabiht>. Does the performance 
appraisal system indeed tap those dimensions of the peiformance that are cnterml to the 
effective job performance? Baile> suggested that there are three approaches to deter- 
mining whether or not the criterion of effective job performance is indeed being 
measured. (1) job analytic procedures, n,^" (2) performance/factor analytic 
approaches,^ 1 ^ and (3) appraiser-generated approaches. <U S If, in the development or 
adaptation of the performance appraisal procedure at least two of those dimensions 
could be utilized, the initial notion of content validity would be addressed. Additional 
content validation can be achieved b> ratings of experts, but the pnmar) sources of 
content validation are the conceptual validation of the job analysis and the empirical 
validation of the factor analytic approaches. 

While content validity lacks the quantitative rigor of other methods, it would be 
erroneous to conclude that this method of validation is inferior, particularly with 
performance appraisal. What i.> central to the concept is that the performance measures 
appropriately samp'e the domain of job content. When these measures are developed 
through comprehensive job analysis, the "inferential leap" between the content of the 
performance measure and the content of the job is minimized. 1 * The "Uniform Guide- 
lines" accord equal status to content validation alone when behaviors and outcomes are 
directly observable.^ Finally, in that focus is on the measure itself, rather than on 
external variables, content validity is often the only practical choice. 

Criterion -related validity is, of course, alwa>s considered appropriate. There are 
some problems with predictive validity in regard to the item and resources necessary to 
conduct the longitudinal study necessary for predictive studies. If the concurrent study 
is conducted with on-the-job employees as the criterion respondents to the instrument, 
there are serious problems as the criterion respondents to the instrument, there are 
serious problems with the employees not being directly similar to prospective employ- 
ees, with their having learned on-the-job, and with their experiencing lower levels of 
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test anxiety. While this is valuable information, such concurrent studies must be 
viewed with caution. 

Cautions are in order regarding face validity ™ > w While an instrument appearing to 
measure what it is designed to measure is indeed a 4rong public relations factor, one 
must be most careful about the emphasis given to claims of face validity and to the 
qualifications of those making the face validit) judgments. Nonetheless, an instrument 
which appears to be relevant crrtainly meets with more acceptance than does one that 
seems foreign or unrelated to one's job performance. 

The final validity issue that might be addressed is that of convergent/discriminant 
validity.-* 0 With multiple measures of many of the traits, attributes, and behaviors 
contained in a performance appraisal process, such a validity study is most appropriate. 

The reliability issue regarding performance appraisals must be addressed from two 
perspectives: (1) reliability of the instrument and (2) inter-rater reliability. Osgood, 
Succi, and Tannenbaum used factor analytic studies to test for internal consistency.^ 
Currently, the coefficient alpha is in wide use to test for internal consistency.^ 

The issue of inter-rater reliability is a serious consideration, and the primary vari- 
able affecting it is training in the use of the procedure. That issue is addressed in 
Chapter 6, which focuses on minimizing rater errors. 
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Communication Factors in Appraisal 

Mark E. Meadows 



Supervisors in many organizations see little practical value in conducting perfor- 
mance appraisals. 1 This attitude ma> be exacerbated in postsecondary education 
settings where administrators are first and foremost scholars within increasingly narrow 
disciplines and not always skilled or expert in managerial functions. Performance 
appraisal systems have yielded disappointing results within the community college 
environment, even so, effecting such a system is significant to the success of 
community colleges. 2 

Saliance of Communication to Performance Appraisal 

There is mounting evidence that success or failure of performance appraisal rests 
on the effectiveness of the terminal appraisal event, that is, the appraisal interview. 3 
Laird and Clampitt cited research which suggested that performance review interviews 
make employees more defensive and self-conscious about then job behavior. 4 Goodall, 
Wilson, and Waagen claimed that fear of what performance appraisals might yield 
keeps the appraisal process from achieving its full potential.' Appraisers experience 
high levels of anxiety when giving negative feedback* and futility because they either 
do not believe they can do what is required of them in performance appraisals or that 
the environment will not be responsible to their efforts. T For appraisees, "The perfor- 
mance appraisal interview is a situation that determines . . . survival or death." 1 * Clearly, 
performance appraisal interviews are complex, potentially charged situations which call 
for appraiser communication skills of the highest order. 

Maier recommended that performance appraisal issues be approached as communi- 
cation problems. He contended, "The success or failure of an employee development 
program largely depends on the skill with which employees are interviewed b> their 
supervisors." 0 At its simplest level, the performance appraisal interview is a communi- 
cation event in which two persons attempt to exchange meanings through spoken 
words. Regrettably, simplicity in communication is quickly lost in complexity. 
Norman Cousins, a former Saturday Renew etiuoi, concluded a highly publicized con- 
flict with exasperation "The most difficult and precarious enterprise in the world is 
communication. It is the ultimate act." 10 
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It has long been claimed that communication is the number one problem in 
management. 1 1 It should follow that managers and supervisors must assume responsi- 
bility to see that effective communication takes place in appraisal interviews. As the 
more expert or more accountable person, the supervisor needs to establish conditions 
that are conducive to effective communication and model good communication skills in 
appraisal interviews. Communication is the only technique managers hove for 
exchanging meaning with subordinates. How else can the supervisor explore job per- 
formance with an employee; provide an employee with feedback on how closel) work 
quality approximates expectations, dispense important, though intangible, rewards for 
jobs well done, or establish goals? The performance appraisal interview is considered 
the primary context for supervisors and employers to work together to achieve superior 
performance. 12 

Napier and Latham are among researchers in performance appiaisal who have 
detected a shift in research from foci emphasizing psychometric qualities of rating and 
evaluation instruments to a focus on the appraiser. ^ Although they emphasize complex 
social learning theory in explaining appraiser interview behaviors, Napier ana Latham 
are only two among numerous writers and researchers in peiformance appraisal who 
place emphasis on the key role of communication variables in performance appraisal. 
Communication between appraiser and appraisee is affected by fears ot what 
performance appraisals might yield. GoodalK Wilson, and Waagen focus on the hierar- 
chical nature of such communication, that is, communication between a superior and a 
subordinate. 14 Wexley described two primary objectives of the appraisal interview, 
both accomplished through communication variables. He gave special attention to the 
direction of communication flow in organizations. Because the flow is usually down- 
ward, distortion, inaccuracy, and suspicion result. Wexley 's view of appraiser role is 
that of a helper whose primary mle is communication.^ Stano focused on appraiser 
communication skills and the importance of appraisee participation in discussion as 
factors affecting the quality of performance appraisals.' 11 Laird and Clampitt identified 
dissemination of results through the interview as one of four major problems in con- 
ducting performance appraisals.' 7 

Review of research related to performance appraisal, and especially that which 
deals with problems encountered, makes abundantly clear the fact that appraiser- 
appraisee interaction variables- communication if you will- account in large part for the 
success or failure of performance appraisal sy stems. Given that fact, and accepting as 
an assumption that the supervisor/appraiser has the primary responsibility to see that 
good communication takes place, the remainder of this chapter is devoted to two topics: 
(1) a brief description of key communication concepts and (2) communication problems 
inherent in performance appraisal, together with suggestions foi mitigating communi- 
cation problems. 
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Communication Concepts 

Communication may be defined as the process of exchanging meaning between 
persons. Person A, the sender or encoder, conve>s a message to Person B, the receiver 
or decoder, who interprets tne message and responds (encodes) in some way to let 
Person A know that the message has been received. When Person B decodes and inter- 
prets A's message ihc simplest form of interpersonal communication has taken place. 
For the purpose of reinforcing the fact that the leader must take responsibility to insure 
that effective communication occurs in the performance appiaisal process, it will be 
helpful if readers identify themselves as persons encoding, or sending, verbal messages 
in the content that follows, that is, as Person A. Figure 5. 1 depicts the basic communi- 
cation transaction which occurs in any form of communication, including performance 
appraisal. 




Fig. 5.1. Baste Communication Transaction 



Frequently, appraisers sending mc^ages find that their purposes are not achieved; 
the receiver (appraisee) does not respond as expected or possibly does not respond at 
all. When communication is viewed simpl> as "sending" a message, we may safely 
assume that communication will not take pla^e. As with the Tango, communication is a 
two-way process. It takes two people to hold an effective performance discussion. 18 
Further, the two persons must be in contact, have each other's attention, and attach 
similar meanings to messages. In summary, there must be a sender who transmits a 
message to a receiver who understands the meaning of the message in the same sense as 
the sender. The sender ascertains that communication has taken place by securing 
feedback from the receiver. Only then can the sender know whether a message has 
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been accurately communicated or vvhethei the message needs to he revised and encoded 
again. Wexley described as one of two priman objectives ofapp.uisal interviews feed- 
back to appraisees. 1 '' 

Feedback is especially impor.r- when the purpose of communication is instru- 
mental; that is, to obtain a beha\ ioral response from the receiv er of the me.ssaae. When 
such messages are sent, feedback is best obtained In asking, "Now, tell mc\vhai you 
are going to do." The supervisor needs to know what is understood bv die supervisee 
When a subordinate is asked, "Do you understand?" theie is considerable pressure to 
answer, Yes," Otherwise, one's superior might think one is not intelligent. 

We communicate best with those who ha\e experiences similar to our own;, how- 
ever, few persons enjoy the luxury of communicating with a narrow lanac of persons 
altogether similar to themselvo. In Figure 5.1, the messages of A and B are shaded 
differently to comniuricate the tact that their experiential backgrounds will "shade" 
their messages. Employees of higher educational institutions now represent a broader 
range of cultural, ethnic, and socioeconomic baekgiound than in the past.: ' Communi- 
cator differences in experiential background uin cause senders and receivers to attach 
quite different meanings to the same words and objects to the extent that messages sent 
are not identical to messages received. Sensitivit) and efforts to increase knowfedse of 
diverse groups are called for. Appraiser who wish to improve communication must 
learn to hear messages from the "frame of reference" of others. 

The needs of those communicating can cause breakdown in eommunication. The 
sender may feel a need to put the recei- er "in his or her place." The iceeiver may feel 
threatened when communicating with the sender. Both sender and receiver can enhance 
the likelihood of effective communication b> being as aware as possible of bom his/her 
own needs and those of the person with whom the\ eommunicate, however, this is 
especially a responsibility of the leader/appraiser. Sueh awareness u»n reduce defensive 
behavior and rid the interaction of eomnninieation distortions that defensiveness elicits 
and sustains. Figure 5 2 represents two basic needs of everv person, the need to protect 
oneself and the need to enhance oneself. When these needs aie threatened or thwarted 
communication will break down. 

It is important to communication effectiveness that senders eomnnmicate clearly 
their expectations In most performance appraisal inten icw s appraiser send messages 
that attempt to elicit a behavioral icspoiise, that is, an instiuniental icsponse. Unless 
senders make expectations explicit, the dexiied icsponse dill not be forthcomimi. There 
is appreciable evidence in support of the so-called Pvsmalion effect, thai*" persons 
generally respond to expectations However, if expectations uk not cleai and responses 
are not those sought, inappropriate axsui,i r ..,oiis about the eompetcnc) ol a subordinate 
may be made when, in fact, that assumption is not justified. 

Beliefs of both sender and receiver create difficulties in eonimunicauon. Napier 
and Latham draw from social learning thcorj to identify two cognitive variables which 
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are sources of fun'ity experienced b> appraisers, self-efficacy and outcome expecta- 
tions.2! Appraisers who belie\e they cannot do what is required of them (low self-effi- 
cacy) experience feelings of futility because the) do not belie\e the environment will be 
responsive to their efforts, they ha\e poor outcome expectations In either ease belief 
systems of communicators can interfere with communication. 

Attitudes are as po'ent as beliefs in creating communication difficulties. Supervi- 
sors communicate a certain altitude when they confer with supervisees only on their 
own turf rather than in the supervisee's workplace or a neutral setting. Communication 
across the physical barrier of a supervisor's desk does not improve understanding.- 
Figure 5.3 is an attempt to depict some of the multiple human factors that are constantly 
affecting the flow of messages between two persons. Again, the appraiser must assume 
primary responsibility for recogni?ing the impact of these factors and in reducing any 
negative impact they have in communicating with appraisers. 



protect 




Enhance 



Fig 5 2 Two Basic Needs AHectmg Communication 



Finally, poor listeners make poor communicators. All too often, simple failure to 
listen is the cause of communication breakdown. Two poor listening habits predomi- 
nate as communication barriers. One of these is the tendency to "attach evaluative 
judgments to what others say. Rather than listening, the receiver is making judgments, 
filtering the message, and thereby failing to recene all the meaning intended by the 
sender One method for breaking thU habit is for the appraioer/supervisor to adopt the 
non-evaluati\e feedback rule. Before the appraiser responds to an appraisee statement, 
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the message must be repeated b> the appraiser until the appraisee recognizes that both 
the content and feelings expressed are understood.- 1 The tendency to listen evaluatively 
contributes to another poor listening habit Instead of attending full> to what the sender 
is saying, the receiver ma> be forming responds. When receivers are preoccupied with 
how they will respond to points being made by senders, the points are usually missed. 
Stano advocated that managers be taught to listen carefully and accurately, to give 
reflective feedback, and to ask appropriate, open-ended, non-directive questions. Stano 
felt that careful listening was especiallv. important in encouraging subordinates to talk.- 4 



Beliefs 




Fig. 5.3. Factors Affecting the Flow of Messages Between Persons 



Performance Appraisal Situations With 
Inherent Communication Problems 

The performance appraisal interview is rife with situations whn.li have potential for 
communication breakdown. These include the hierarchical nature of such events, ^ 
inherently evaluative aspens of performance appraisal, multiple purposes of some 
appraisal interviews, 2 ^ influence of the environmental climate, including non-verbal 
aspects of performance appraisal interviews, 2 " Each of these special situations is dis- 
cussed below in terms of the unique communication problem(s) posed, together with 
suggestions for mitigating communication breakdown. 
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Burke identified the "mystery" that surrounds hierarchical communication, . . the 
conditions for 'mystery' are set by an> pronounced social distinction ... the social dis- 
tinction between clerk and office/manager makes them subtly mysterious to each other, 
not merely two different people, but representing two classes or 'kinds' of people." 28 
The existence of mystery between classes of beings points out an essential quality of the 
performance appraisal interview, a superior will be communicating with an inferior in 
the organization. Goodall, Wilson, and Waagen pointed out that when mystery inter- 
cedes in communication between different classes of beings, the common response is to 
retreat to ritual forms of address; that is, communicative behaviors that are guided by 
commonly understood cultural and social stereotypes, traditional etiquette, gender- 
specific, or race-specific rules. 29 Both interviewer and interviewee are encouraged to 
rely on and to respond to prepackaged scripts for the situation that derive rules from 
commonly understood cultural values and standards. 30 "In short, the mystery present in 
the situation is reinforced by ntual forms of communication. "^ In the face of pressures 
to retreat to fixed, conventional forms of communication between appraiser/appraisee, 
the appraiser must assume responsibility to assure that the barrier is broken and that 
honest, open communication occurs. 

Although some experts in performance appraisal advocate that managers treat 
employees as equals, 1 - it does not follow that the employee will adopt this attitude or 
that such attempts of managers will be credible, especially if the manager's behavior is 
not consistent with past behavior. 33 Review of the literature suggests that the primary 
way to reduce the "mystery" in supervisor/subordinate communication is to facilitate 
participation of the subordinate, the manager needs skills that encourages subordinates 
to talk. 3 * Participation is encouraged through active listening,^ manager behaviors that 
arc spontaneous, friendly, sensitive, that show interest in subordinates, and thai are 
nonjudgmental> The best place for the appraisal interview is a neutral setting and not 
in the manager's office, thus reducing the distance over which communication occurs. 
Finally, Goodall et al. discussed the central purpose of performance appraisal interviews 
from the frame of reference of both the supervisor and the subordinate. 37 They stressed 
the need for clarity of purpose of the appraisal for each party. When there is a common 
understanding of what the parameters of the performance interview are, the appraisee is 
more likely to experience the safety required for self-disclosure and risk-taking, thereby 
making the interview a more authentic, spontaneous experience. Bellman stated, "A 
performance discussion without objectives is not a performance discussion." 38 In 
summary, the negative effects of status differences on communication within the 
performance interview are mitigated when the appraiser (1) assumes responsibility to 
see that effective communication occurs, (2) listens carefully, (3) clarifies interview 
purposes and goals, and (4) involves the appraisee in all phases of performance 
appraisal, including the design of the program.^ Wlicn possible^ the employer should 
be allowed to rate his own performance.^ 

The fact that performance appraisals exist in part to provide evaluative feedback to 
appraisees constitutes another critical communication variable in performance 
appraisal Bennett and Chater underscored this aspect of appraisal in postsecondary 
settings They cited several current concerns in higher education that have led faculty 
and administrators alike to tighten their judgments. Bennett and Chater especially made 
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a case for evaluating the performance of tenured fauilt) in order to foster and maintain 
excelled performance. m It is note\vorth> that virtuall> no literature on performance 
appraisal posits a view that does not include the evaluative nature of performance 
appraisal. 

Given that evaluation either takes place or that existing evaluation data are pre- 
sented in appraisal interviews, what can be done to reduce its negative impact? Three 
basic communication techniques that have potential to reduce the negative effects of 
employee evaluation in the performance interview are offered, feedback clarification, 
non-evaluative listening, and achieving an appropriate balance of praise and criticism. 
It should be noted again that the interviewer/supervisor must assume responsibility to 
use such techniques, although employees can also be taught these skills. 

Non-evaluative listening involves receiving communication from an appraisee 
without placing any vaiue judgment on the message or the sender, that is, concentrating 
on tasks, roles, and results rather than the personality of the interviewee. 4 - Ironically, 
by temporarily suspending intentions in performance counseling interviews, one may 
more likely achieve goals because interviewee resistance is decreased by curtailing 
judgments. 41 Feedback clarification refers to the ability to paraphrase content back to 
the speaker and to reflect the feelings of the speaker. « When an appraiser provides 
accurate feedback, the appraisee adds to his/her self understanding, resulting in 
improved self-esteem and personal effectiveness. It i k , not sufficient to simply repeat 
back, or mimic, the words cf the appraisee, it is necessary to feed back accurate under- 
standings of both content and feelings expressed. 

Much has been written about the so-called "sandwich" technique where negative 
evaluations are sandwiched between praises. Stano believed that skill in balancing 
praise and criticism in performance interviews can help circumvent the debilitating 
effects of evaluation, however, he believes that the "sandwich" technique is too obvi- 
ous. He recommends dispensing supportive feedback almost exclusively at the begin- 
ning of the interview, thus, establishing an initial positive climate and creating 
appraisee receptiveness to more thorough analysis in aieas where improvement is 
needed. 45 

Use of feeiback clarification, non evaluative listening, and balancing praise and 
criticism in performance interviews minimize the negative aspects of communicating 
evaluative messages m one other significant way. b> reducing the likelihood of open 
hostility. SkopecN research findings support that uncertainty in dealing with con- 
frontations and other hostile interviewee reactions and the need to maintain" satisfactory 
interpersonal relationships following appraisal interviews constitute primary concerns 
of performance appraisers When appraisers are heard accurately and understood, they 
are less likely to be hostile and confrontive.*^ 

Laird and Ciampitt claimed that the performance appraisal process .nay be sabo- 
taged by multiple use of appraisal documents. Stano summarized litem lire on this 
matter and concluded that it was universally agreed that to combine discussion of 
development and salary is deleterious He believed that performance interview* should 
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have a narrow focus confined to either the objective of development or to perfor- 
mance/salary review. « Banks and Murphy suggested that in assessing candidates for 
promotion, the interview should focus on behavior required for more advanced jobs, 
whereas in salary administration, the focus should be on behavior required in the 
appraisee's own job. 49 

Wexley discussed the appraisal interview in terms of two directions, administrative 
and employee development. The purpose of the form is to communicate and support 
administrative decisions such as salary increases, promotions, transfers, etc., the pur- 
pose of the latter is to enable each employee to get feedback as to how well he/she is 
doing and to provide an opportunity to discuss improvement of performance. "Both 
(purposes) cannot usually be accomplished during the same session, inasmuch as the 
manager is being asked to play the conflicting roles of judge and helper."^ Mount, in a 
study of employee and r.unager satisfaction with the appraisal process in a large cor- 
poration, found that both groups supported the concept of separating salary considera- 
tions from employee appraisals.^ It is noteworthy that both groups consider the quality 
of appraisal discussion one of the most important factors is satisfaction with the 
program. 

Combining development goals with administrative tasks such as salary administra- 
tion within the appraisal interview creates an improbable communication problem in 
that the appraiser has dual role.,. "The superior cannot establish a warm, supportive 
climate if he or she is ruling on the employee's paycheck. The employee will not be 
open to a discussion of weakness if he or she feels that such a disclosure will result in 
economic sanction." 52 

Every organization has a climate in which communication occurs.53 Climate 
factors must be considered at both the organizational level (macro) and at the perfor- 
mance appraisal interview level (micro). Climate factors at the organizational level 
refer to processes related to such factors as leadership, communication, decision- 
making, goal setting, and processes.^ Wexley drew upon the seminal work of Likert to 
illustrate how organizations differ with respect to climate factors.** At one extreme is 
the System 1 organization where there is no perceived evidence of trust between 
manager and subordinate, interaction is restricted, decisions are all made at the top, and 
employee participation is discouraged. In a System 1 organization communication 
flows downward, tends to be distorted, inaccurate, and viewed with suspicion. At the 
other extreme is the System 4 organization which is characterized by supportive rela- 
tionships, group decision-making, open and extensive interaction, and high participa- 
tion. In a System 4 organization communication flows freely throughout-upward, 
downward, and laterally. Information is accurate and undistorted> It is apparent that 
appraisal interviews would take on quite different characteristics within these different 
environments What seems clear is that communication in organizations oriented 
toward System 4 would be quite superior to that in System 1. 

Climate exists as a communication variable at the micro level of the performance 
appraisal interview as well. 'The climate present in an appraisal interview is affected 
by a complexity of interlocking and intangible variables."^ Variables include both 
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physical and personal factors that surround the performance interview. Where the 
interview is held is an important factor. Experts disagree on this. Wexley suggested the 
interview take place in either the appraiser's or appraisee's office. 58 Stano believed the 
best place is a neutral territory that is relatively isolated from routine distractions.** 
What seems important is that a place be selected for the interview that is comfortable 
for both parties, that will provide appropriate privacy, isolation, and no interruptions, 
and that does not serve to increase mystery, or distance, that already exits. Arrange- 
ments within the interview room are important climate factors, those that reduce differ- 
ences in status and distance facilitate effective communications. For example, side-to- 
side or corner seating is preferred to communicating across the expanse of a desk. 
Proxemic variables such as these are examples of non-verbal communication that can 
serve to reduce or expand status or hierarchical differences between appraiser and 
appraisee. 

The impact of climate considerations, whether at the organizational-wide or 
personal level, may be observed at the appraisal interview level. If appraiser behavior 
is substantially incongruent with organizational characteristics experienced day-to-day 
by appraisees, distrust and suspicion will be engendered. If appraiser non-verbal 
behavior, that is, facial expression, gestures, posture, lack of eye contact, etc., contra- 
dicts what is said verbally, appraisees will get a mixed message. Non-verbal behavior 
is perceived as more reliable and accurate than the verbal message when they are in 
conflict. 60 Communicators are constantly using two channels of communication, i.e., 
verbal and non-verbal. 

The importance of climate factors at the individual level are illustrated by Stano. 
"Overall, communication will be more open and honest and problem-solving will be 
facilitated if the manager can genuinely consider the employee as equal and can appear 
spontaneous, friendly, supportive, sensitive to and interested in the difficulties of the 
worker, understanding, and cooperative, nonjudgmental with regard to feelings 
revealed, nonmanipulative, concerned for the dignity and worth of the individual, 
trusting, and confident of the employee's abilities." 61 Figure 5.4 provides a list of 
factors which Can constitute barriers to effective communication. 

Summary 

Review of the performance appraisal interview and the complex processes which 
occur in the act of communication between appraiser and appraisee leads to a series of 
statements which might summarize and give direction to communicative behavior on 
the part of appraisers. 

1. The appraisal interview is an exceedingly complex communication event that 
can have negative implications for both appraisee and appraiser The employee may 
become defensive and view the interview as the deciding factor in his/her ultimate 
destiny. The appraiser many times experiences high levels of anxiety and feels some 
sense of futility in evaluating an employee's performance. 
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Fig. 5.4. Barriers to Effective Communication 



B 
A 
R 
R 
I 

E 
R 

S 



2 To help overcome these feelings,* management should attempt to establish an 
environment conducive to effective communication. Special attention should be 
addressed to the hierarchical nature of this communication process. 

3, Communication is a two-way process, and both parties communicating 
should be using the same points of reference Validation is accomplished through both 
parties providing feedback so that a common, ground of understanding can be achieved. 

4 We communicate best with people who have similar backgrounds to our own 
and with people with whom we are neither threatened by nor do we threaten. 

5. Expectations should be made explicit and clear. 

6 Differences in beliefs cause difficulties in communication, especially in low 
or high self-efficacy beliefs. 
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7. Differences in attitudes construct a barrier in communications between indi- 
viduals. 

8. Poor listeners are not good communicators. The non-evaluative feedback 
rule can help open the lines of communication and assume that all the meaning intended 
by the sender is received by the receiver 

9. There is a hierarchical relationship between employee and appraiser/ 
supervisor, i.e., there are two different classes of people, each with his/hei own customs 
and rituals, trying to communicate but possibly not undei standing v\hcre each is coming 
from. Thus, both may fall back on societal norms and scripts and ma) never actually 
communicate. 

10. To overcome this, a manager should facilitate participation of subordinates. 
This can be done through active listening, facilitativc communication behaviors, and 
structuring the organizational and personal environment in ways that arc conducive to 
effective communication. The purpose of the interview should be stated clearly. 

11. To reduce the negative impact of the performance interview the appraiser 
should provide feedback clarification, non-evaluative listening, and attempt to achieve a 
balance between praise and criticism. 

12. Multiple use of appraisal documents and interviews can cause pioblems. The 
interview should have precise and clearly defined paianietcis and not mingle personal 
development and administrative objectives. 

13. All organizations have a climate which coiiMsts of two levels, micro and 
macro; i.e , personal and oiganizational. Both physical and personal factors affect the 
climate that surrounds the performance interview. Communication will be of a higher 
quality in a climate which encourages participation and diminishes status differences. 

14 Finally, the sine qua nun of effective performance appiaisal communication 
is appraiser acceptance of responsibility for the quality of communication which takes 
place. When performance interviews are characterized by facilitativc communication 
processes, both personal and organizational development occurs. 



1. Nancy K. Napier and Gary P Latham, "Outcome Ivxpectancies of People 
Who Conduct Performance Appraisals," Pit sound Psuholog) 39 (Winter 1986), pp. 



Robert G Lahti, "Appraising Managerial Perfoimancc." Junior College 



Resource Review, (January 1981), pp. 3-6. 

3. hric Wm Skopee, "Rhetorical Dimensions of Performance Appraisal Inter- 
views," Papei presented at the Annual Meeting of the Eastern Communication Associa- 
tion (75th, Philadelphia, PA, March 8-11, 1984), pp. 1 10, Napier and Latham, op. (it., 



Endnotes 



827-837. 




» 



Communication Factors 69 



pp. 827-837; and Kenneth N. Wc\Ie>, "Appraisal Interview;' in Performance Assess- 
ment Methods and Applications, ed. Ron » Id A. Berk (Baltimore. Johns Hopkins Press, 
1986), pp 167-185. 

4. Angela Laird and Phillip G. Clumpitt, "Effective Performance Appraisal: 
Viewpoints from Managers," The Journal of Business Communication 22.3, pp. 49-57. 

5. H. Lloyd Coodall, Jr., Gerald L. Wilson, and Christopher L Waagen, "The 
Performance Appraisal Interview. An Interpretive Assessment," Quartet l\ Journal of 
Speech 72 (February 1986), pp. 74-87. 

6. Skopec, op. ciu pp. 1-10 

7. Napier and Latham, op. cit.. pp. 827-837. 

8. Goodall, Wilson, and Waagen, op at . p. 87 

9. N R. F. Meier, Apptais'ng Perfotmancc (La JoIIa, CA. University Associates, 
Inc., 1976). 

10. Norman Cousins, "The Mersey Episode," Satuiday Review (Jainiarv 1977). 

11. Interpersonal Communication. A Guide for Staff Dexelopment, Institute of 
Government, Georgia Center for Continuing Education, 1974. 

12 Mark E. Meadows, "Personal Communication and Organizational Effective- 
ness," Appalachian Business Review 7:2 ( 1 979), pp. 2-6. 

13 Napier and Latham, op at* pp. 827-837. 

14. Goodall, Wilson, and Waagen, op cit , pp. 74-87. 

1 5. Wexley, op. cit., pp. 1 67- 1 85 

16 Michael Stano, "Guidelines for Conducting the Performance Appraisal Inter- 
view: A Literature Synthesis," Journal of Applied Communnation Research 9.2 (Fall 
1981), pp. 131-142. 

17. Laird and Clampitt, op. at., pp. 49-57 

18. Geoff Bellman, "Nine Wavs to Up tirade Performance Discussions," Train- 
ing/ IIRD 1 8 (Febiuary 198 J ), pp. 35-38. 

19. Wexley, op n/. t pp 167-185 

20. Meadows, op at., pp. 2-6 

21. Napier and Latham, op cit , pp 827 S^7. 

22. Stano, op cit... pp. 131-142. 

23. John F Kikorski and Joseph A. Littcrci, "Ettective Communication in the 
Performance Appraisal Review," Publn Personnel Management 12 (1983), pp 33-42, 
in Goodall, Wilson, and Waagen, op at . p. 74 

24. Stano, op. at., pp. 1 3 1 - 142 

25. Goodall, Wilson, and Waagen, op, at , pp. 74-87. 



ERIC 



70 Performance Appraisal 



26. Stanley B. Silverman and Kenneth N. Wexley, "Reaction of Employees to 
Performance Appraisal Interviews as a Function of Their Participation in Rating Scale 
Development," Personnel Psychology 37 (Winter 1984), pp. 703-710. Laird and 
Clampitt, <jp cit., pp. 49-57; Stano, op, nr., pp. 131-142; and Wexley, op at., nn 1 67- 
185. 

27. Wexley. op. cit., pp. 167-185. 

28. Kenneth Burke, A Rhetoric of Motives (Berkeley, CA. University of 
California Press, 1969) in Goodall, Wilson, and Waage.i. op cit , p. 74. 

29. Goodall, Wilson, and Waagen, op nr., p. 74. 

30. Ibid, p. 74 

31. Ibid. 

32. Stano, op. cit.* pp. 131-142. 

33. Goodali, Wilson, and Waagen, op nr., pp. 74-87, and Laird and Clampitt, 
op. cit., pp. 131-142. 

34. Stano, op cit., pp 131-142, and Goodall, Wilson, and Waagen, op. at.., pp. 
74-87. 

35. Goodall, Wilson, and Waagen, op. cit., pp. 74-87. 

36. Stano, op. cit., pp. 131-142. 

37. Goodall, Wilson, and Waagen, op. at., pp. 74-87. 

38. Bellman, op at., pp. 35-38. 

39. Stano, op. cit., pp. 131-142. 

40. Laird and Clampitt, op. cit., pp. 49-57. 

41. John B. Bennett and Shirley S. Chater. Evaluating the Performance of 
Tenured Faculty Members," Educational Record 65 (Spring 1984), pp. 38 41 

42. Stano, op. at, pp. 131-142. 
43 Meadows, op cit., pp. 2-6. 

44. Kikorski and Litterer in Goodall, Wilson, and Waagen, op. at , p. 74. 

45. Stano, op. cit , pp. 131-1 42. 

46. Skopec, op. at., pp. 1-10. 

47. Laird and Clampitt, op cit., pp. 49-57 

48. Stano, op cit., pp. 131-142. 

49. Christina G Banks a J Kevin R. Murph), "T oward Narrow ing the Research- 
Practice Gap in Performance Appraisal." Personnel /\\\t holi>}>\ 38 (Summer 1985), pp 
335-345. 

50. Wexley,^/?. cit, p. 170. 



ERIC 



Communication Factors 71 



51 Michael K. Mount, "Comparisons of Managerial and Employee Satisfaction 
with a Performance Appraisal Svstem," Personnel P.\uholoi>\ 3* (Soring 1983), pp. 
99-109. 

52. Laird and Clampitt, op. at , p. 56. 

53. Meadows, op c/r. : , pp. 2-6. 

54. Wexley, op. nr., pp. 1 67- 1 85. 

55 R. Likert, "Motivational Approach to Management Development," Harvard 
Business Review 37:4 (1959), pp. 75-82 in Stano, op, aL pp. 131-142. 

56. Wexley, op nr., pp. 167-185. 

57. Stano, op cit„ p. 135. 

58. Wexley, op, nr., pp 167-185. 

59. Stano, op. nr., pp. 131-142. 

60 Rodney Napier and Matti K. Geislierfield, Gtoups, Theory and Experience 
(Boston, MA: Houghlin Mifflin Company) 

61. Stano, op, nr., p. 135. 



ERIC 



6 



Minimizing Rater Errors in Observing and 
Appraising Performance 

William I. Sauser, Jr. 



Having a well-designed performance appraisal instrument and process is essential 
if the resulting evaluations are to be useful. However, e\en the most carefully con- 
structed devices and programs will not assure success in gathering valuable information 
if the human beings who use the instruments are not willing or" able to employ them 
properly. 

The persons who observe and appraise performance are very much a part of the 
measurement process. No matter how fine an instrument the> are using, if the raters are 
unreliable or invalid in their observations and appraisals, then the resulting information 
will be unreliable and invalid, and thus, not suitable for any purpose 

Unfortunately, human beings tend to be very poor ©valuators of behavior, as the 
following except from die work of John Bemardin and Richard Beatt) attests. 

Research in psychology is replete with examples of the potential difficulties 
confronting performance appraisers People apparently do not attend very well 
to base-rate information; they express excessive and unjustified confidence in 
their judgments; they make predictive judgments that are biased m comparison 
with normative standards; they are subject to hindsight biases, they have self- 
serving biases in person perception. the> underestimate the role of contextual 
factors affecting behavior, their judgments of covariation are inaccurate, they 
resort to erroneous judgmental heuristics, and so on . . . and on. . . There can 
be no question that some raters of performance commit these errors in 
judgment, as well as many others J 

The existence of these and other r.iter enois have been known for >ears^.u Some 
of the more common cirors vvhich haw Seen identified and studied in detail are 
described in Exhibit 6.I.* 5 
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Since the existence of these errors is so pervasive, and their effects are so poten- 
tially damaging, it is important to take ever> possible precaution to avoid them. The 
following ten suggestions for minimising rater errors in observing and appraising 
performance are discussed in this chapter: 

1. Select appropriate raters. 

2. Clarify the purpose of the performance appraisal program. 

3. Choose the right format and content. 

4. Involve the raters in creating or interpreting the rating scale. 

5. Train the raters. 

6. Provide opportunities for the raters to observe the performance being 
appraised. 

7. Help the raters keep records of meaningful observations. 

8. Standardize the rating context. 

9. Motivate the raters to do a good job. 
10. Maintain the quality of the program. 

Administrators who follow these steps when implementing their performance 
appraisal programs will be rewarded with more meaningful data than will those who 
ignore these powerful suggestions for minimising niter errors. 

7. Select appropriate raters. 

There is evidence to support the belief that >ome persons are better than others at 
rating performance. For example, after n» icwing numerous research studies on this 
topic, Ronald Taft in 1955 concluded: 

. . that the following characteristics are faui> consistently found to be posi- 
tively correlated with the abilit) to judge the peisonality characteristics of 
others: (a) age 'children), (b) high intelligence and academic ability (with 
analytic judgments especially), (c) specialization in the physical sciences, 
(d) esthetic and dramatic interests, (e) insight into one's status with respect to 
one's peers on specific traits, (f) good emotional adjustment and integration 
. . . and (g) social skill 6 

More recently, Walter Bonnan found that personal qualities related to accuracy of 
appraisal include verbal reasoning, freedom fiom self doubt, high self-control, and an 
orientation toward details. 7 

In most organizational settings there arc practical constraints winch make it diffi- 
cult to apply the findings of Taft and Bornun. Most administrators do not have the 
luxury to pick and choose accurate raters from a pool of potential appraisers. However, 
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it would not be wise to ignore these important findings. Ratings turned in by indi- 
viduals who are poorly adjusted 01 are undergoing a personal or emotional tnsis-or 
who have proven to be grossly inattentive to details-are suspect and could be very 
damaging to the integrity of the performance appraisal process. 

A more practical approach to the selection of potential raters is offered b> Kenneth 
Wexley and Richard Klimoski. They suggest: 

The person doing the assessment must. (1) be in a position to observe the 
behavior and performance cf the individual of interest, (2) be knowledgeable 
about the dimensions or features of performance, (3) have an understanding of 
the scale format and the instrument itself, and (4) must be motivated to do a 
conscientious job of rating. 8 

Note that in an academic setting this ma> call for multiple raters, each attending to 
a specific aspect of a professor's performance. Tor example, the department head may 
be in the best position to observe and evaluate adherence to polic> and departmental 
service; students may be the best sources of data regarding the professor's day-to-day 
classroom performance, peers ma> be the best judges of The adequacy of syllabi and 
tests; and outside reviewers ma> be the best soun.es of unbiased evaluations of writing 
and creative work. 

The point is that there are some steps the administrator can take to make certain 
that persons are fairl> evaluated. Individuals who. ( 1 ) have no opportunity to observe 
the performance in question, (2) do not understand the rating scale, (3) are obviously 
biased toward or against the individual being appraised, ^4) are poorl> adjusted or 
undergoing a personal or emotional crisis, or (5) have proven to be grossl) inattentive to 
details should not be selected to take part in the performance appraisal process. 

2. Clarify the purpose of the performance appraisal program. 

Performance appraisal ratings can be used for a variety of purposes, including 
providing feedback to the ratee, justify ing personnel actions, identifying training needs 
and special talents, placing employees into propel jobs, fostering accountability, and 
improving organizational effectiveness.'* The specific purpose for which appraisal 
ratings are collected can affect the motivatioi -and thus the behavior-of the raters who 
are providing the scores, as noted in the blowing passage from the work of Wallace 
Lonergan: 

Appraisal programs are doomed to failure if employes associate them with 
determination of firing and layoffs Such negative associations not only 
engender resentment and distrust on the part of the employees, but also put the 
assessing supervisor on the spot Similarly, if appraisal programs become 
associated with favorable management action, a supervisor, wishing to show 
the department in a good light, might understandabl) upgrade an employe's 
ratings, thus adding Jeliberate distortion to , Ireadv biased human judgment." 1 

er|c uj 
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Bernardin and Beattv arc also concerned that the iatei have a cleai understanding 
of the purpose of the appraisal program lest the rater distiust the process. 

One factor that affects rater iiK)ti\ation has to do w ah the trust mdi\ idual raters 
have in the appraisal process. Trust in the appiaisal process mav be defined as 
the extent to which both raters and ratees percei\e that the appraisal data will 
be (or has been) rated accurate!) and fairh and the extent to which the> per- 
ceive that the appraisal data will be (or has been) used faul> and objecti\el> 
for pertinent personnel decisions. 11 

If the raters are confused about the purpose of the appiaisal program, or if the pro- 
grain seems to be designed to fulfill two or more conflicting purposes, not onl> might 
the raters lose trust in the program, the) ma) become frustrated and angr) as well. 

For example, suppose that one objective' of an appiaisal program is to deter- 
mine salary increases. In this case, assessing supervisors frequently emphasize 
the strengths of an employee if the) feel that the employee deserves an 
increase Suppose that at the same time the appraisal program is being used to 
improve performance. With this objective in mind, the assessing supervisor 
may feel obligated to point out an emplovee\s relative weaknesses in order to 
identify areas for improvement. Inevitably the assessing supervisors will find 
themselves in a frustrating, if not untenable, position in attempting to use the 
assessments for these differing purposes l ~ 

It was recognized at least sixty )cais ago that knowledge of the purpose for which 
ratings werj to be used might influence the scores provided, therefore, the conventional 
wisdom was as follows. "To avoid this enoi, ratings should be secured w ,1, lb*" r.uers 
in ignorance of their use and if possible at a time in advance of the situa ion demanding 
their use/' >3 

Given Bernardin and Beatt)*s concerns about trust in the appraisal process, it is 
likely that this conventional wisdom could do with some icv ision. Administiators who 
desire to construct a performance appraisal system which will be accepted and used 
should inform the potential rateis of all intended uses of the lesuhing data This will at 
least reduce any distortion and variance in ratings due to speculation regarding their 
use. 

As a final note, while pcrfoi mancc appraisal ratings can indeed be used foi a vari- 
ety of purposes, Lonergan suggests that setting individual development as the primary 
objective of an appraisal program has at least four advantages. 

1 The program is likel) to be more' acceptable to employees and to 
gam their support rather than arouse their resentment. 

2. There is less obvious reason for the assessing supervisors to 
introduce deliberate distortion into the assessments to achieve 
their own ends. 



ERLC 



Minamzinp Rater Erron 77 



3 Feelings of stress and stiain on the part of both the assessing 
supervisors and the employees are lessened. 

4. Assessments will probably reflect the facts better. 1 * 



3. Choose the right format and content, 

As noted in Chapter Three of this volume, there is a \ude vanet\ of appraisal tech- 
niques and formats from which to choose, each with puiticulur strengths and weak- 
nesses mfi It does make a difference which format is chosen for use. since" some 
formats are better suited for one use than another. 

Bemardin and Beatty have provided the following summary of what they believe to 
be the most important contingencies regarding the efficae> of the various appraisal 
methods: 

If the purpose of appraisal requires comparisons of people across raters for 
important decisions, then Management By Objectives (MBO) . . . (is) inappro- 
priate since (it is) typically not ba.,ed on a common measurement scheme. If 
there is low trust among raters, and if ratings are linked to important personnel 
decisions . . , then the forced- choice method is recommended since it is more 
resistant to deliberate rating inflation than other methods. ... If the Behav- 
iorally Anchored Rating Scale (BARS) method is to be adopted, then diary- 
keeping should be incorporated as a formal component of the process. 
Such an approach is not oniy more effective at inhibiting halo than oth^r 
methods; it also provides documentation for summary ratines and a data source 
for validating individual raters If the purpose of appraisal is test validation, 
then the relatively high levels of reliability and variability for personnel-com- 
parison methods certainly support their use, providing a behavioral format is 
adopted for the comparisons and assumptions can be met for comparisons 
across raters If the purpose of appraisal is to improve performance, then 
MBO is the best strategy, providing uncontaminated. quantifiable data are 
available n 

These results of Bernardin and Beatty \s compiehensive review of the research 
literature point out the importance of cleat 1> defining the purpose of the performance 
appraisal program before choosing and implementing am particular assessment 
technique. 

Richard Khmoski warns practitioners also to consider carefully the content of 
assessment before selecting a scale for implementation. lie describes three traditional 
options of assessment ronient: (1) personal traits or qualities of an individual, (2) oer- 
formance results, and (3) behaviors exhibited on the job,™ 

As it turns out, each of these approaches to defining (referencing) effectiveness 
has strengths and weaknesses. Each is more or less applicable to particular 
jobs, to types of industries, and to differing management philosophies. Each 
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one will be more or less appropriate depending on the purpose of the assess- 
ment. For example, a results approach might be more suitable as a basis for 
awarding a bonus. A beha\ ior emphasis would be better when assessments are 
to be used to determine a manager's training needs. A person or trait orienta- 
tion makes sense when the assessment is to be used as input to making a pro- 
motion decision. In the last case, we need to predict a person's likely future 
success, and knowing his or her personal traits or qualities helps us to do this. lg 

The message of this section is that the format and content of the assessment device 
to be implemented should certainly not be determined arbitrarily if rater errors in obser- 
vation and appraisal are to be avoided. Administrators should consider carefully the 
organizational context, the prevailing managerial philosophy and the purpose for 
carrying out the appraisal program before any decisions about format or content are 
made. 



4. Involve the raters in creating or interpreting the rating scale. 

Douglas McGregor argues that supervisors are very reluctant to "play God" in 
appraising employes' performance, and implies that they may intentionally distort 
ratings as a result of this reluctance. 20 Some of the reasons for managers' resistance to 
performance appraisal cited b> McGregor include. ( 1 ) a normal dislike of criticizing a 
subordinate (and perhaps having to argue about it), (2) lack of interviewing skills, (3) 
dislike of new procedures v.ith accompanying changes in ways of operating, and (4) 
mistrust of the validity of the appraisal instrument. 21 

Carl Kujawski and Drew Young suggest, "Too often this resistance is justified. If 
an appraisal program is developed independently by a staff unit and imposed from 
above, it has a good chance for failure. However,, it doesn't have to be this way,' — 

Kujawski and Young point out Peter Drucker's major suggestion for overcoming 
resistance to change. "Workers must be provided with opportunities for participation 
that will give them a managerial view."^ They then translate Drucker's device into a 
pragmatic suggestion for administrators who are trying to implement a workable 
appraisal progiam: 

One approach is to have the personnel department work with a cross section of 
management in developing the appraisal program. Onee the outline of the 
program has been established, it can be circulated to a larger group of 
managers for review and comment, and the program modified as needed. 

Depending on the particular needs of the organization and the results desired, 
Ihe number of levels of management involved in the design of the program will 
vary. The critical factor is that the users of the program be involved. By being 
so, they will come to "own" the program, and therefore will be more willing to 
support it because it is theirs. 24 
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The motivational effect of participation in the development of performance rating 
scales has been documented in the research literature.- Raters are typically proud of 
the rating scales the) develop through their own efforts and are motivated to use them 
effectively. 

Rater participation in scale construction can also have a second major benefit, 
particularly when Patricia Smith and Lome Kendall's "retranslation technique"--the 
process used to develop Behauoraliy Anchored Rating Scales (BARS)-is employed.- 
William Sauser notes: 

When employees work together to est„'Jish a standardized set of performance 
levels and dimensions to evaluate, the> typically reach a common understand- 
ing of the meaning of each dimension and anchor point. Thus, the rater 
participation process serves to greatly reduce the problem of each rater inter- 
preting the scales differently.^ 

One problem with Smith and Kendall's retranslation process is that it is very 
cumbersome and time-consuming. Fortunately, a shortcut method for constructing 
BARS has been devised- 0 ™ The psychometric quality of the scales which have been 
produced using this shortcut technique is similar to that of scales developed with the 
unabridged method. 

Participation in scale construction almost always leads to an improvement in rater 
motivation. However, the examples described above seem to indicate that the addi- 
tional benefit- creating a common understanding of the meaning of scale dimensions 
and anchor points- accrues only when such participation is in the form of involvement 
in the "retranslation process." How can this additional benefit be obtained when work- 
ing with scales which are not of the BARS format? 

This question has been answered by the development of a type of training program, 
called "frame-of reference training," which involves raters not in the development of 
the scale, but rather in the interpretation of the sealed An example of the practical 
application of frame-of-reference training is described below. In this particular exam- 
p!e, the standardized instrument m use was a trait rating scale: 

One possible modification with which I have been experimenting in my rater 
training workshops may prove to be valuable. Workshop participants are 
asked to develop, m small task groups, meaningful definitions of each 
dimension of the standardised scale with which they axe working. Each task 
group also produces behavioral anchors for each level of a particular 
standardized scale. After these definitions and anchors have been devised, the 
workshop convenes in full session, and each task group presents its p:oduets. 
All workshops participants then seek to agree upon a common set of 
performance dimensions and standards.' 52 
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In summary, two major benefits can result from allowing raters tu participate in the 
scale construction or interpretation process. (1) the laters will gain a sense of 
"ownership" of the scale, their resistance 1 to its use will be lessened, and the motivation 
to intentionally distort scale scores will be reduced, and (2j the raters are more likely to 
develop a common frame of reference, the) will share similar interpretations of scale 
dimensions and anchor points, and unintentional distortion will be reduced. 

Administrators wishing to minimize rater error> in observing and appraising 
performance would thus be well advised to allow rater> to participate in the creation of 
the scales themselvv.,, or at least m the interpretation of standardized scales within the 
organizational context. 

5. Train the laters. 

In 1954 v J. P. Guilford stated, "Various experiences with ratings tend to show that 
the most effective method for improving ratings in many ways is to train raters care- 
fully."^ The documented effectiveness of a variety of types of training programs 
carried out in a number of different organizational settings in the three decades since 
Guilford made that statement testify to its truth. M In fact, Kujawski and Young claim 
that "A comprehensive training program for supervisors who will serve as appraisers is 
one of the most valuable aspects of the implementation process."^" 

What should be the content of a comprehensive rater training program? William 
HoIIey and Kenneth Jennings have supplied the following excellent answer to this 
question: 

Training programs for appraisers should focus on lmpioving both obserw- 
tional and evaluative skills. Appraisers nmi to be taught what kinds of 
behav lors distinguish high from low performers, how to avoid perceptual and 
judgmental errors, and how to understand appraisal formats so as to use them 
appropriately for their intended purposes. Also, it is important that raters 
know how to select the relevant information for making an accurate appraisal. 
Training programs should actively involve the potential appraisers in the 
training process, and appraisers should be provided an opportunity to partici 
pate in group discussions and pracUce performance interviews. While the 
content of the training program shuuld vary according to the organization's 
needs, training should also aim to change the aUitudes of the appraisers, where 
necessary frequently performance appraisal programs fail because' of the lack 
of rater motivation either due to lack of understanding or poor instructions Vl 

Duane Schultz suggests that rater tunning > lould involve two steps. 

1. Creating an awareness that abilities and skill s are usually distributed 
in accordance w.th the normal curve, so that it is perfectly 
acceptable to find large differences among a group of workeis, and 
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2. Developing the ability to define appropriate criteria for the behav- 
iors being evaluated, a standard or average performance against 
which employees may be compared ? 7 

James Buford and Son> a Collins add thai the workshop method is an excellent way 
to train raters to reduce errors: 

Trainees should have the opportunity to observe errors being made in an 
appraisal conference if possible. Videotapes are effective and can be used 
repeatedly. Raters should at least review written situational exercises. They 
should attempt to identify the errors that are being made and then complete 
their own ratings. Through group discussion, trainees have the opportunity to 
receive feedback regarding their own rating behavior and practice the correct 
techniques.^ 

Latham and Wexley have described in detail an excellent workshop employing the 
kind of videotaped exercises recommended b> Buford and Collins.^ Administrators 
would do well to review the Latham and Wexlev program when devising their own 
training sessions Another useful training device is the Atlantic Richfield Company's 
guide tor individual raters 40 

Exhibit 6.2 contains a detailed training outline which was devised to facilitate the 
implementation of a BARS-type faculty evaluation instrument in a university setting." 
Research with this training program found it to be verv effective in minimizing rater 
errors. 4 - 

The implications of this section should be verv k lear. Tram jour raters if you want 
to minimize errors in observing and appraising performance. Providing a comprehen- 
sive ratei Gaining program is probably the most important step in implementing an 
effective appraisal system Time and energy invested in rater training will pay huge 
dividends in terms of the accuracy cf ihe data resulting from the appraisal process. 

6. Provide opportunities for the raters to observe the performance being 
appraised. 

In an earlier section of this chapter administrators were advised to select raters who 
are in a position to observe the performance in question However, simply being in 
position to observe is not enough, as the following passage illustrates. 

Supervisors meeting informally over coffee or lunch frequently brag about and 
share amusing anecdotes regarding their employees' behavioi and work per- 
formance As they do this, the supervisor are actually informally evaluating 
their employees, often on the basis of a few randomly observed events or 
remarks. ... Ins during these infernal, loosely structured discussions that 
e? ployees . . . begin to acquire reputations. . . In the absence of more accu- 
rate data regarding employee work performance, . . . decision* might typically 
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be made on the basis of the reputational factors resulting rom the informal 
evaluation process mentioned above. However, reputations, since they are 
based mostly on hearsay and random comments and observations, often 
present inaccurate, distorted, biased pictures of employes' true abilities and 
performance. (I am certain that all of us from time to time wonder why our 
supervisors are never around to see us when we make a particularly brilliant 
decision or complete a difficult task, but alway s seem to appear just in time to 
catch us in a blunder.) 4 * 

How can an administrator make certain that a rater's observations are objective and 
fair rather than biased and distorted? AH of the suggestions in this chapter are directed 
toward that end, however, there are three things in particular that should be done to 
address this problem. 

First, the administrator should make certain that the raters understand exactly what 
it is they are looking for. While the> are observing, the) should be primed to notice 
specific incidents of effective or ineffective behavior. This is why a comprehensive 
rater training program must contain information on the kinds of behaviors which distin- 
guish among levels of performance. As Christina Banks and Kevin Murphy state, 
"Training orograms should not train appraisers merely to observe, rather they should 
train them Low to decide what to observe/ 14 (Note that if it is unclear what behaviors 
actually distinguish effective from ineffective performance, a job analysis is clearly in 
order. 45) 

Second, the administrator should ascertain that all raters take a systematic approach 
to gathering the information they need to make accurate appraisals. For exampie, if a 
department head is to evaluate the quality of each faculty member's publications on an 
annual basis, she should certainly have a process in place to collect copies of all pub- 
lished work- not just those papers which the faculty happen to bring to her attention. 
Similarly, if a committee of peers is to evaluate a colleague's classroom teaching 
performance. the committee should devise and follow a plan that allows periodic class- 
room vi sits -not just a single visit that may fall on a particularly good or bad day for 
their colleague. 

Third, the administrator should see that all raters keep some sort of orderly record 
of their observations. By recording these observations over a period of time, then refer- 
ring to the complete record when providing an appraisal, the rater can avoid being 
overly influenced by recent events or isolated incidents of irregular behavior. The next 
section describes some of the techniques which can be employed to assist raters in 
keeping useful records of their observations. 

7. Help the raters keep records of meaningful observations. 

Many performance appraisal programs call foi ratings to be collected on a periodic 
basis, such as annually. It is assumed that the rater takes into consideration the ratee's 
typical performance across the entire span of the rating period when filling out the 
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performance appraisal form Unfortunately it is \er> difficult for supervisors to 
remember all of the incidents of performance which the> may ha\e observed over the 
year, so this assumption is very difficult to support. In fact, it is probable that many 
raters base their scores upon recent observations and a few "unforgettable" instances of 
behavior they recall from earlier in the year. 

Although these recalled instances ma> be "unforgettable:' they ma> not be remem- 
bered accurately, since most human beings are not blessed with total recall. Instead, 
these remembered samples of behavior may become distorted over time due to the 
frailties of human memory, they ma> also be colored and reinterpreted in the mind by 
incidents which have occurred during the intervening period of time. 

Furthermore, the "unforgettable" incidents ma> not be t> pica! of the ratee's day-to- 
day performance. While a spectacular success or failure during the year should 
certainly be considered when rating an employee \> behavior, one or two "unforgettable" 
incidents should not overshadow the hundreds of instances of more typical behavior 
which have occurred during the rating period Otherwise, the ratings will be distorted; 
they will not be valid as true measures of typical behavior across the period covered by 
the performance appraisal. 

Since human memory is not infallible, how can raters be helped to recall accurately 
typical instances of behavior which occur across a span of time? The best approach is 
to keep records of observations as they occur, and to refer to these records when filling 
out the performance appraisal instrument. Three record-keeping approaches which 
have been devised to help raters are described in this section. These approaches are: 
(1) keeping a critical incident file, (2) keeping a diary, and (3) using a checklist. 

In 1954, John Flanagan introduced a job analysis method which he called "the 
critical incident technique."* This method was quickly adapted for use in a perfor- 
mance appraisal context.* 7 The method calls for the observer to provide anecdotal 
descriptions of effective and ineffective job behaviors which have actually been 
observed in the work setting. These anecdotal observations, called "critical incidents " 
have been characterized as follows: 

The observer reporting the critical incident is typically asked to describe: 
(1) what led up to the incident and the context m which it occurred, (2) exactly 
what the individual did that was effective or ineffective, (3) the apparent 
consequences of this behavior, and (4) whether or not the consequences were 
under the individual's control. 48 

Two examples of critical incidents, one positive and one negative, are piovided in 
Exhibit 6.3. 

During the year, the rater could jot down notes regarding all critical incidents 
observed, and could file these notes in a "critical incident file." This file could then be 
consulted when the performance appraisal form was to be completed. This procedure 
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will ensure that behavioral observations from throughout the rating period are consid- 
ered when ratings are provided, thus deceasing c rors of distortion due to faulty 
memory. 

The critical incident file will also be beneficial during counseling discussions with 
the ratee, since it will allow the supervisor to illustrate latings with actual observations 
of behavior. This will provide more objectivity to the performance appraisal interview, 
and will reduce feelings of "arbitrariness" when ratings are discussed with subordinates. 

Note that it is not necessary to "stockpile" the critical incident file until the annual 
apprabal season rolls around. Instead, each incident could serve as the basis of a con- 
temporaneous coaching interview between the supervisor and subordinate. Positive 
incidents could serve as rea.sons for praise and other reinforcement, negative incidents 
as cause for correction. The critical incident tile, accompanied b> records of resulting 
commendation or reprimand, would then become a cumulative record of each subordi- 
nate's performance during the year and an objective basis fv.r a valid perfoimance 
appraisal rating 

It should be further noted that anecdotes of behavior written some time after the 
incidents have occurred are subject to the same errors of distortion as are other 
memories. It is for this reason that critical incidents should be written at the time of 
their occurrence, not several months later. Raters who attempt to produce from 
memory their critical incident files on the da> they are to be used for performance 
appraisal purposes are negating the value of the procedure. 

Flanagan's critical incident technique, combined with Smith and Kendall's appli- 
cation of the Thurstone scaling technique to critical incidents, has led to the develop- 
ment of several performance appraisal methods, including behaviorally anchored rating 
scales, mixed standard rating scales, and weighted checklists. 4 '^" As noted earlier in 
this chapter. Bernardin and Beatty suggest that keeping a formal, contemporaneous 
diary of behavioral observations is an important component in the successful imple- 
mentation of performance appraisal programs UMiig these methods." 1 Based on their 
review of research regarding the usefulness of diary -keeping, they make the following 
recommendation: 

We recommend that a formal system of diary keeping be implemented after 
raier training and that it is monitored h> the rater's supervisor. We also 
recommend that the rater be made aware that the observation of the ratee's 
behavior is an important supervisor) function and that the most important part 
of the appraisal process takes place during the observation period, rather than 
in the ten minutes when summary ratings are actually done.* 5 - 

Since maintaining a critical incident file and keeping a diary are simply two differ- 
ent manifestations of the same concept, Bernardin and Beatty *s suggestions for writing 
descriptions of behavior, presented n Lxhibit 6 4, apply equally to both methods of 
record -keeping. M 
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The third technique which is available to help raters keep accurate records of their 
observations is the use of a checklist. Exhibit 6.5 displays a checklist devised by 
William Ronan for evaluating college classroom teaching effectiveness/ 4 

Ronan's checklist was devised for students to use when evaluating the classroom 
teaching performance of their profe>sors. Similar checklists can be devTsed for use by a 
variety of observers from different perspectives. The secret to devising these checklists 
is to perform a thorough job analysis-using the critical incident technique or a similar 
method-to determine the key behaviors which distinguish effective from ineffective 
performance. Brief descriptions of these key behaviors are then arranged in checklist 
format and provided to observers who are in a position to see the occurrence of these 
key behaviors. 

The checklist thus serves two important purposes. It. (1) focuses the observers' 
attention on important behaviors, and {2) provides a record of those behaviors which 
were actually observed. 

Note that the checklist could be formatted such that the observer would provide the 
actual time and place each behavior occurred, or that each incident which occurred 
would be described in more detail in anecdotal form. The checklist could even be 
formatted such that the observer could rate the frequency of occurrence of each behav- 
ior, or that each behavior be weighted in terms of its contribution to effectiveness. 
These and other modifications serve as the bases for such modern performance 
appraisal systems as Behavioral Observation Scales, Behavior Summary Scales, 
Behavioral Discrimination Scales, and Behavioral Assessment Approaches. 55 - 56 

This section has described three tools which are available to help raters keep 
records of meaningful observations, the critical incident file, diary-keeping, and the use 
of checklists. Which format is employed in any performance appraisal system is a 
matter of preference, however, the employment of one or more of these tools-or 
another such tool which forces raters to keep contemporaneous records of important 
instances of behavior-is essential if the system is to produce valid measures of perfor- 
mance during the period of time represented by the appraisal rating. 

8. Standardize the ratmg context 

Holley and Jennings have described the importance of standardizing the perfor- 
mance appraisal rating process: 

Because appraisals are used to make judgments for personnel decisions, such 
as promotions and compensation, and appraisal data are used to make com- 
parisons among employees, appraisal systems must be standardized in form 
and administration. Lack of standardization in forms, appraisers, procedures, 
and jo on raises the question of whether differences in performance appraisals 
result from the system and its administration rather than from differences in 
employee's performance. 57 
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Many of the suggestions presented in previous sections of this chapter are focused 
on providing this necessar> standardization. For example, the proper appraisal instru- 
ment must be chosen so that all raters are using the same device. Rater selection, 
training, and involvement are intended to ensure that all raters share a common view- 
point and understanding of the appraisal process. The techniques described in the 
previous two sections are designed to make certain that there is standardization in the 
observation and recording of key instances of actual behavior. 

However, there are other factors in the appraisal setting which also must be consid- 
ered. For example, William Sauser, Carlos Arauz, and Randall Chambers found that 
the level of background noise present when ratings were produced could have a signifi- 
cant effect on those ratings/* Other contextual factors which have been found to influ- 
ence ratings include the presence of higher level supervisors in the room where ratings 
are produced, the number of ratees evaluated in one session, the presence of environ- 
mental stressors, and the time available for making the ratings.^ 

Administrators who are serious about reducing the possibility of error in perfor- 
mance appraisals should consider standardizing such contextual factors as the time and 
place in which ratings are done, the number of ratees to be appraised at one time, and 
the presence of supervisors, trainers, and other persons when ratings are being 
produced. It should be obvious that a rater who is trying to evaluate 35 subordinates in 
an hour while working in a hot, crowded, noisv room late at night will quite likely pro- 
duce different scores than when evaluating five subordinates in an entire morning while 
working in quiet, comfortable surroundings. 

To maintain fairness for all ratees, the administrator should ascertain that all ratings 
are produced under the same standardized env ironmental conditions. This may require, 
for instance, that a specified time and place be established at which all raters will per- 
form their work. 



9. Motivate the raters to do a good job. 

No matter how sophisticated a performance appraisal svstem has been established, 
no matter how well the raters have been trained, no matter how many observations of 
behavior have been recorded, no matter how carefully the context has been standard- 
ized, there still remains an essential factor which heavil) influences the validity of the 
ratings obtained, "individual raters and their motivation (or lack of motivation) to rate 
accurately. 

Richard Klimoski makes the following observation concerning this crucial factor. 

(Ultimately) the critical issue of motivation toward accuracy must be 
confronted But, in my opinion, it can only be dealt with by creating a climate 
or ethic for careful and considered employee assessment. 1 also feel that prime 
responsibility for doing this lies with upper management, and especially with 
the chief executive officer.^ 
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Some of the ideas Klinioski provides to create this climate include the following: 

K Top management must establish and support specialists within the 
organization itself who are capable of developing and implementing 
appraisal systems. 

2. Top management must personall> use a:id demonstrate careful assessment 
of its own staff. Actions speak louder than words. 

3. Careful performance assessment should be made an explicit part of each 
manager's job responsibility. It may even be written into a job 
description. 

4. Make use of appraisal data in corporate decisions affecting staffing. . . . 
Decisions with regard to promotions, to reductions in force, or to salary 
adjustments should be based, at least in part, on assessed performance.^ 

Commitment from the top has long been recognized as the ke> to successful 
implementation of any organization-wide program. Klimoski has provided excellent 
advice to be followed b> administrators who want to demonstrate a real commitment tc 
the implementation of a valid performance appraisal system. 

10. Maintain the quality of the program. 

Any administrator who follows the nine suggestions described above when devel- 
oping and implementing a performance appraisal program will most likel> construct an 
outstanding system which will produce valid, useful results. However, just hke the 
finest automobiles, performance appraisal systems must be properly maintained if they 
are to continue to operate at optimal levels. 

The administrator who wishes to maintain an excellent system should make certain 
that appraisal forms and observational aids are kept relevant and up-to-date, particularly 
when job content has changed. New supervisors must be properly trained, and all raters 
should be given periodic "refresher courses' to make certain they are continuing to 
interpret and use the scales in the prescribed manner. Statistical analyses should be per- 
formed to monitor the reliability and validity of performance appraisal ratings.^ Raters 
should be periodically reminded of the importance of accurate ratings, and reinforced 
for doing a good job of appraising and developing subordinates. Finally, the entire 
appraisal process should be subjected to a periodic program evaluation to make certain 
that it is still meeting the objectives originally established ioi lt-and revised if it is not, 
oi if the objectives have changed. 

Within this context of progiam evaluation for perlormance appraisal systems, the 
administrator should attend tc the sage words of Kujawski and Young 
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Ensuring that ;*v appraisal forms arc being completed is only pan of the 
monitoring procedure Many organizations are proud of the fact that all ot 
their appraisal forms are submitted on time with all of the proper signatures in 
their proper places and that they have files full of them to prove that this is 
being done. But how well are the appraisals being used? In an effective pro- 
gram, the emphasis is on the results produced. " These can be checked by 
asking such questions as: What is the turnover rate 0 Are people being 
promoted from within or does the organization have to go outside to get quali- 
fied people to fill vacancies? How do the people using the program feel about 
it? Do they feel that it is meeting their needs and the needs of the organiza- 
tion? Is it being revised to meet changing organizational goals? w 

After ail, the performance appraisal system is a tool designed to enhance urganiza- 
tional effectiveness. It should be examine penodicalh to make certain that it is 
achieving that purpose. 



Conclusion 

Due to the frailties of human skills in observation, perception, memor> , and evalu- 
ation, any performance appraisal system which liiUudes human beings as part of the 
process will necesNaril> include some level of error. However, there are steps which 
administrators can take to greatly minimize this level of error. 

This chapter has presented ten techniques which are designed to reduce rater errors 
in observing and appraising performance. These techniques are. (1) select appropriate 
raters, (2) clarify the purpose of the performance appraisal program, (3) choose the right 
format and content, (4) involve raters in creating or interpreting the rating scale, (5) 
train the raters, (6) prov ide opportunities for the raters to observe the performance being 
appraised, (7) help the raters keep records of meaningful observations, (8) standardize 
the rating context, (9) motivate the raters to do a good job, and (10) maintain the quality 
of the program. 

Administrators who use these techniques when devising and implementing their 
performance appraisal programs will be richly rewarded. The resuumg appraisal 
systems should serve as powerfu' tools fin enhancing organizational effectiveness. 
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Exhibit 6.1. Common Rater Errors Which Should Be Avoided 

Leniency -- This error occurs when the supervisor rates an employee (and probably other employees) 
higher on every item of the rating scale than the employee's true 1c el of performance actually 



Severity -- This error, the opposite of leniency, occurs when the supervisor rates an employee (and prob- 
ably other employees) lower on every item of the rating scale than the employee's true level of 
performance actually deserves. 

Central Tendency -- This error occurs when the cvaluator uses only the central portion of the scale, 
ignoring the high and low extremes, even when the employee's true level of performance deserves 
an unusually high or low rating. 

Extremity - This error, the opposite of central tendency, occurs when the cvaluator uses only the high 
and low extremes of the scale, ignoring the central portion, even when the employee's true level of 
performance deserves a more moderate rating. 

Halo -- This error occurs when the cvaluator forms a general, overall impression of the employee's 
performance, then fills out the rating form to reflect this impression. This practice should be 
avoided. Instead, the rater should consider each item on the scale individually and should try not to 
let his/her rating of the employee on one item influence the rating on another item. 

Logical - This error, similar to the halo error, occurs when the cvaluator, in an attempt to appear consis- 
tent, bases his/her rating on "logic" rather than on observation, thus allowing h^cr response to one 
scale item to unjustly influence the response to another. As stated above, each item on the scale 
should be considered individually. An employe's level of performance will typically not be 
perfectly consistent (from item to item), thus there is no requirement that the rating of the employee 
be somehow logically consistent. What is important is that the ratings reflect only the employee's 
actual level of performance on each item. 

Proximity - This error, similar to the two above, occurs when the supervisor allows his/her rating on one 
item of the scale to influence the rating on a second item simply because the two items arc located 
close to one another on the scale. Again, each item should be considered independently. 

Contrast and Comparison - These errors occur when the supervisor rates his/her employees not accord- 
ing to the standards specified on the scale, but in contrast or comparison to some other kind of 
standard, such as the performance of the best or worst employee the supervisor has ever known, the 
level of performance the supervisor thinks he/she could attain if he/she were doing the job, etc. 
Each employee should be evaluated independently according to the standards specified on the rating 
scale, not in comparison with other employees, ideals, etc. 



Source William I Sauscr. Jr, A Comparative Evaluation uf the Effects of Rater Participation and Rater Training on 
Characteristics of Employte Performance Appraisal Ratings and Related Mediating V ariables (Doctoral Disscruuon) 
(Atlanta: Georgia Institute of Technology. 1978). pp 216-217. 



deserves. 
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Exhibit 6.2. A Comprehensi\e Training Outline for Student Raters of Faculty Classroom 
Teaching Performance 

I. Clarification of the aims and purposes ol rating. 

A The evaluation of professors' leaching performance is a commonly occurring e\ent. 

1 When we think of "facull> evaluation," we usuall) visualize a formal process involving 
rating forms, computer printouts, etc. Actually, the evaluation of professors' teaching 
performance occurs quite often, usually in an informal manner. 

2 Students frequently "compare notes" and "spread the word" about professors. As they 
do this, the students arc informally evaluating their professors, often on the basis of 
reputation and randomly observed events. 

3 Professors often evaluate themselves and other professors in informal discussions. 
These informal evaluations also may be largely based on reputation and randomly 
observed events, as well as comments from two or three students. 

4 Deans, department heads, and others arc faced with making decisions regarding 
promotion, tenure, salary, ^ourse assignments, etc., for their professors. These deci- 
sions require some type of evaluation of the professors in question. When objective 
data arc not available, these decisions are frequent!) based upon some type of informal 
evaluation, such as reputation, random observations, or the comments of two or three 
students or faculty members, even though these are certainly not the fairest ways to 
evaluate laculty members. 

B There is a need for systematic, objective information regarding teaching performance. 

1 For lack of more objective data, important decisions are often made on the basis of the 
"informal evaluation" described above. As noted, much of this informal evaluation is 
based on hearsay, reputation, random comments and observations, etc. These sources 
arc often inaccurate and even unfair They typically present a distorted, biased picture 
of the professor's true teaching ability and performance. In order to increase the possi- 
bilities ol appropriate, unbiased, fair decisions being made, it is necessary to gather 
more objective, systematic,, relevant information about faculty teaching performance. 
Teacher rating forms arc one means of making taciilty evaluation more objective and 
systematic, and less biased. 

2 One major problem with many faculty rating forms is that they can be interpreted dif- 
ferently by each student ra'cr. Thus, characteristics of the type of form used can influ- 
ence the outcome of a teacher evaluation project. Students do not always agree on the 
definition of "good teaching performance," and what one sees as "excellent" perfor- 
mance may be only "fair" to another. Since the outcome of the rating process can be as 
easily influenced by how the raters interpret the form as by the faculty member's actual 
teaching performance, it is important to make sure that all of the raters interpret the 
form as similarly as possible The teaching behaviors to be evaluated and the meaning 
of each point on the scale should be clearly specified to ensure nearly uniform inter- 
pretation Otherwise, the raters may all be rating different aspects of behavior, and the 
data will not be meaningful. 

3 In order to be useful, faculty evaluation data must be reliable. That is, the evaluations 
by several independent raters of the same professor s teaching performance in the same 
class should be relatively consistent-there should be relatively high agreement among 
the ratcis. If there is a very low rate of agreement among the raters, the information 
will obviously be of little use. 
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Some uses of objective faculty evaluation data. 

1. Feedback --Objective faculty evaluation data serve as relatively effective feedback from 
the students to their professors. Teacher evaluation form.s enable students to communi- 
cate ideas to their teachers, to make then teachers aAare of particular strengths and 
weaknesses in their courses and in their teaching methods, and to suggest improvement 
when necessary. Since learning depends on feedback, this information is essential if 
professors arc to improve their courses and teaching methods in the future. The 
primary use of faculty rating forms is to provide this important feedback to the indi- 
vidual faculty members. 

2 Personnel actio ns-Ob)QC\\\c faculty evaluation data, when available, can be used to 
influence decisions regarding such issues as tenure, promotion, and salary adjustment. 
Decisions based on objective data are typically fairer than those based on hearsay, 
reputation, and other "informal" data. Student evaluations of teaming performance arc 
rarely the major criteria considered when personnel action decisions are made, but they 
can certainly have some influence. 

3. Development --Objective faculty evaluation data can help dean^ and department heads 
'dentify any particular training needs or special ta;ents in their professors, thus provid- 
ing them with suggesfons for faculty development. Individual professors can also 
identify their own particular weaknesses and seek to improve themselves. 

4. Placement-Objective faculty evaluation uala can be used to influence decisions 
regarding course assignments, class si/cs, etc. 

5 Responsibility-The faculty evaluation process often enhances a professor's feelings of 
responsibility toward hisfter students and duties as a teacher. 

6. Effectiveness-- 1 ** .iuugh the above uses, objXtivc faculty evaluation data can help 
improve departmental, school, and university effectiveness, as well as the effectiveness 
of the individual faculty member. 

Additional points regarding faculty evaluation 

1. There are many different duties involved in the job of college professor. While class- 
room teaching :s not the professor's only responsibility, it is an important part of 
h^cr job. Auburn University lists teaching as its faculty members' most important 
duty. 

2. Students arc not f he oni> persons whose evaluations of tc<K hing performance should be 
sought, but their evaluations should be considered carefully. Students are one of the 
major consumer groups of the university's expertise and arc certainly affected by the 
faculty's performance. Furthermore, whereas deans, department heads, and other 
faculty members rarely observe professors' teaching performance first-hand, and thus 
ire not in a strong position to provide objective data, students are in an excellent posi- 
tion to observe ar J report on faculty teaching behavior. 

3 Teaching is multi dimensional. There are many facets of teaching performance and it 
is probably not possible to take all of them into account in any one performance 
measuie or rating form. The rating form should, however, cover as many important 
teaching behaviors as possible and should certainly provide adequate coverage of the 
facets it is intended to measure. 

4. The purpose of faculty vvaluation is to improve professors' teaching performance, not 
to damage faculty members in any way The process should only be used construc- 
tively, never destructively. 
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II. Introduction of ihc Bchaviorally Anchored Rating Scale. 

A Most faculty rating forms arc developed b> administrator* or faculty committees with 
limited student input. The scale used in tins project, however, was developed through 
student participauon. and is intended to be clear and meaningful to btudenl raters. The scale 
dimensions and behavioral examples were provided b> Auburn students participating in 
earlier phases of this study 

(Vote \t ihis point in ihe training iCssiun ihe >cak i« shown to the trainees A lull description ul the scale includes 
Uic following points ) 

B. Instruction on the meaning of the characteristics to be evaluated. 

C. Instruction on the meaning of each anchor point used on the scale. 

D. Instruction on how to use the scale. 

III. Instruction on the avoidance of common pitfalls m rating 
A Lack of objectivity 

1 Some student raters evaluate their professors on the basis of supposition, guesswork,, 
and reputation thus defeating the entire purpose of using the rating forms. A student's 
rating of his/her professor should be based onl> upon first-hand observations of actual 
behaviors, not commenb made b> other sludenu, reputational factors, etc. A student 
who has not observed a teacher first-hand should not cv aluate that teacher Nor should 
a student let his/her rating of a professor be influenced b> what other students think. 

2 Some student ratcrL base their entire rating of a professor on one or two instances of 
extreme!) good or extremely poor teaching behavior. While these isolated extreme 
instances should certainly be considered, it is important also to keep in mind the typi- 
cal, "day-in, day-out" behavior of the professor. 

3 All students lend to have "first impressions' of their teachers, but some students never 
change these impressions, even in the face of behaviors to the contrary, and base their 
ratings exclusively on 'heir first impressions. The professor's behavior throughout the 
quarter should be considered when his/her performance is being evaluated. 

4 The most common problem involving lack of objectivity is allowing some biasing 
factor to affect a professor's raing. As difficult as it is, student raters should strive not 
to let such factors as the professor's ag., sex, rank, or appearance, the course's level of 
difficulty, or the student's own performance (i.e., grade in the course) or personal liking 
or disliking of the professor influence the performance ratings given to the professor. 
A student's rating of his/her professor should be influenced only by the professor's 
actual behavior while teaching the course, not by any biasing factor. Non-teaching 
behaviors, such as consulting and research, should also typically be ignored when the 
professor's teaching performance is being evaluated. 

B. Common rating "errors" to avoid. 

(Note This presentation is accompanied h> 4 visual disp!a> oJ how these errors would appear on ihc Heha\ioraJly 
Anchored Rating Scale ) 

1, Lenicncy--T\\\± "error" occurs wh:n the student rales the professor (and probably other 
professors) higher on nery item of Ihe rating scale than the professor's true level of 
performance actually deserves. 
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2. Severity-This "error," the opposite of leniency, occurs when ihc student rates the 
professor (and probably other professors) louer on every ucm of the rating scale than 
the professor's true level of performance actually deserves. 

^ Central iendency--T\\\s "error" occurs when the student uses onl> the central portion of 
the scale, ignoring the high and Jow extremes, even when the professor's true level of 
performance deserves an unusually high or low rating. 

4 Exiremity~T\\is "error," the opposite of central tendency, occurs when the student uses 
only the high and low extremes of the scale, ignoring the central portion, even when the 
professor's true level of performance deserves a more moderate rating. 

5 //a/o -This "error" occurs when the student forms a general, overall impression of the 
professor's performance, then fills out the rating form to reflect this impression. This 
practice should be avoided. Instead, the student rater should consider each item on the 
scale individually, and should try not to let his/her rating of the teacher on one item 
influence the rating on another item. 

6 Logical~T\)\s "error," similar to the "halo error," occurs when the student, in an attempt 
to appear consistent, bases his/her rating on "logic" rather than observation, thus 
allowing his/her response to one scale item to unjustly influence the response to 
another. As stated above, each item on the scale should be considered individually. A 
professor's level of performance will typically not be pcrfcctl) consistent (from item to 
item), thus there is no requirement that the student's rating of the professor be some- 
how logically consistent. What is important is that the ratings reflect only the profes- 
sor's actual level of pcrlormancc on each item. 

7. Proximity -This "error," similar to the tvvo above, occurs when the student allows 
his/her rating on one item of the scale to influence the rating on a second item simply 
because the two items arc located close to one another on the scale. Again, each item 
should be considered independently. 

8 Contrast and companson-Thcsc "errors" occur when the student rates his professor 
not according to the standards specified on the scale, but in contrast or comparison to 
some other kind of standard, such as the performance of the best or worst professor the 
stuvlen* has i en known, the level of performance the student thinks he/she could attain 
if he/she were teaching the course, etc. Each professor should be evaluated indepen- 
dently according to the standards specified on the rating stale, not in comparison with 
other teachers, ideals, etc 

IV. Practice in the use of scales. 

(Note During the time remaining in ihc framing session, students praUKL u*ing the Ikhaviorallv Anchored Rating Scales 
to evaluate professors of their o'vn «.hoosing JNo pn fetors arc identified I Students an. eiuouraged to examine their own 
ratings for examples of bias and error, and to correct their ratings when appropriate , 



Source Vv ilham I Sauser, Jr , A Comparative Evaluation oj tht Ljjeit\ oj Hatir Farm ifkilion arui Raur framing or. Character- 
istia of Employee Perfurtnan^t Appraisal Rating and Rilaud SUdtaung \anablts (Doctoral Dissertation) (Atlanta 
Georgia Institute of 'I cchnology, 1978), pp 212-218 
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Exhibit 6.3. Examples of Positive and Negative Incidents of College Classroom 
Teaching Behavior 

Example A (Positive): On the first day of his class, Professor Jones passed out a 
detailed syllabus which included his office location, hours, and telephone number; a 
description of the textbook and dail> reading assignments, his objectives for the course; 
his policies on attendance, testing, calculation of grades, and dishonest behavior; and 
descriptions of several required class assignments. He discussed the syllabus in class 
and answered all questions asked about it. The syllabus served as "the rules of the 
class," and any questions about grading, attendance, or assignments which came up 
during the semester were answered with reference to the written syllabus. The students 
reported that they appreciated having the professor's policies set out clearly at the 
beginning of the semester so that they knew exactly what was expected of them. They 
reported that the syllabus created a sense of fairness and allowed them to concentrate 
their attention on learning course content rather than trying to figure out what was 
expected of them by Professor Jones. 



ExampleB (Negative) Following a lecture over a very complex theory, Professor 
Smith asked his students if they had any questions. One student, obviously confused, 
asked a question which revealed his lac!* of understanding of the theory. Professor 
Smith "blew up" at the student and called him "a .tupid idiot" for failing to understand 
the theory. Professor Smith did not answer the question, nor were any other questions 
asked by the students. After class, several of his classmates told the student who had 
asked the question that they had not understood the theory either, but had been 10 afraid 
to ask a question lest they too be humbled in class. Several students failed the 
subsequent test because their answers indicated a lack of understanding of the theory. 
By handling the student's question different^, Professor Smith might have been able to 
better educate these students. 
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Exhibit 6.4, Bernardin and Beatty's Suggestions for Writing Descriptions of Behavior 

1. Use specific examples of behavior, nol i om lusions about the "goodness" or "hidncss" of bcha\ ior. 

Use this. Gvvcn lold her sccretarv when the work was to be completed, whether it was to be a draft 
or a final copy, the amount of spate in whiJi it had to be typed, and the kind of paper 
necessary. 

Not tins. Licsa gives good instruc lions to her secretary Her instructions are clear and concise 

2. Avoid using adjectiu qualifiers in the statements, use descriptions of bcha\ ior. 

Use this. Anaee repeated an employee's communication and Us intent to the employee. She talked 
in private, and I have never hca T d her repeal the conversation lo others. 

Not this: Kelly does a good job of understanding problems. She is kind and friendl) . 

3. Avoid using statements thai make assumptions about an employee's knowledge of the job, use 
descriptions of behavior. 

Use this. Sarah performed the disassembly procedure for rebuilding a carburetor by first removing 
the cap and then proceeding with the internal components When she was in doubt about 
the procedure, she referred to the appropriate manual. 

Not tins, Sam knows how to disassemble a carburetor in an efficient and effective manner 

4. Avoid using frequencies in state. nenis; use descriptions of behavior. 

Use this. Patrol Officer Garcia performed the search proceujrc by first informing the arrested of 
their rights, asking them to assume the search position, and then conducting the search by 
touching ihe arrested in the prescribed places. When the search was completed, Garcia 
informed the arrested. He then proceeded to the next step in the arrest procedure 

Nol this. Patrol Offiu r D/id/o always does a good job in performing the search procedure 

5. Avoid using quantitative values (numbers), use descriptions of behavior. 

Use this. Nancy submitted her reports on lime. They contained no misinformation or mistakes. 

When discrepancies occ lined on reports from the last period, she identified the causes by 
referring lo the changes inaccountmg procedures and the unpad they had on this period. 

Not this: Mr. Boebcl met 90% of deadlines wiih 95% accuracy. 

6. Provide sufficient detail so that an assessment can be made of the extent lo which characieri aics of 
the situation beyond the control of the ratce may have affected the bcha\ ior. 

Use this. Mr. D/aul/.o's failure to hit the "target date" for the sky -hook ijuola was caused by the 
failure of Mr. Rcssler\s department to provide the ordered supply of linkage gaskets Mr 
D/aid/o submitted four memos in anticipation of and in reference to the gasket shortage. 

Nol this: It wasn't D/aid/o's fault that he didn't hit die deadline. 



Source 1 rom 11 John Bemardin and Richard W Bcatly, Perfor mance Ap pra tMl \ssc ^.m^ Hu man Bihavumr at VWrk 

(Boston Kent Publishing Company. l ( J8t) pp 263 4, ©by NVaJs worth. Inc Repunlcd by permission of PWS KLV1 
Publishing Company, a division of Wads worth, Inc 
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Exhibit 6.5. Ronan's Evaluative Questions for Assessing Teaching Performance 

Note: Each section would be headed v, uh a question such as "Did the professor in this course . . / >M 

I. Personal Relationships with Students Yes 

1 . Know or attempt to know students' names? 

2. Talk with students before and/or after class? 

3. Hold social events for his students? 

4. Give advice or assistance at student request (class cr office) 
with personal problems? 

5. Discuss (answer questions on) extra class issues? 

6. Compliment students on good answers? 

7. Encourage (answer) all questions in class? 

8. Treat all students equally (regardless of sex, major, etc )? 

9. Ridicule, "ride," or otherwise embarrass students (cither on questions or 

their performance) 0 

10. Encourage or give mds vidua! help w ith course material (class or office)? 

1 1 . Lose control of himself in class (shout, curse, show anger, etc.) 9 

12. Bother (harass) students during recitation, quizzes, etc.? 

13. Make threats concerning classwork or personal bcha\ lor? 

14. Accept legitimate excuses, explanations (as lor missing qui/)? 

15. Refuse to listen to or recognize other viewpoints in class? 

16. Say or indicate in some way that students arc inferior 9 

1 7. Provide special "help" session* for course material (incm idual and/or class)? 

II- Classroom Administration 

Meet all scheduled (rescheduled) classes? 

Arrive on time for all classes 0 __ 
Inform class if he would be absent? 

Discuss qui/, dates or deadlines for student convenience 9 

End lectures at end of classtinie? 

Distribute a course outline or study plan (course objectives) 0 

Follow course outline or study plan 0 

Give examples of qui/ items? 

Require and grade homework? 
Return papers snd quizzes promptly? 

Permit classroom disturbances (such as students talking to each other)? 

Make false Statements concerning course requirements < number of 

cuts, grading, etc.) 0 

Give excessive work 0 



» 
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III. Student Participation Yes No 

1. Ask student preference as to topics covered? 

2. Ask students locrihquc his leaching? 

3. Schedule quizzes, deadlines, etc., ai the eonvenicn the class majority'' 

4. Encourage (ask for) discussion, questions, or stmiciu opinions'? 

5. Ask qucsuons lo determine class (individual) understanding of course 

material 9 

IV. Classroom Presence 

1 . Appear well groomed? 

2. Speak clearly and distinct!) 

a. Mumbh? 

b. Talk too softly? 

c. Talk in a monotone? 

3. Use dramatic gestures (phrases) to cmphasi/e important points'* 

4. Use humor in lecture to illustrate points? 

5. Read lectures from notes or book? 

6. Appear nervous, ill-ai-casc during lecture 9 

7. Talk or present material loo rapidly? 

8. Give rambling, disorganized lecture? 

9. Look at students dun ng lecture? 

10. Use language students understand? 

11. Use profane language excessively? 

V. Organization and Presentation of Material 

1 . Begin class with a review of previous work? 

2. Stress, in some way, important points m the material 9 

3. Use current, pcilincnt. and/or personal examples to illustrate point'* 

4. Show usefulness of material in "real world"? 

5. Admit not knowing answer to a question 9 

6. Use outside references to supplement course'* 

7. Distribute handouts/notes to supplement course? 

8. Use visual aids to supplement lecture? 

9. Provide for field trips? 

10. Have guest lecturers? 

11. Have full command of the subject matter? 

12. Give lectures different from (supplement) text? 

1 3. Cover all course requirements? 

14. Avoid trivial detail? 

15. Answer questions; work problems if requested? 

16. Lecture over students 'heads? 

17. Give erroneous information about course materia!" 

18. Rclusc to explain material? 

19. Make students learn "on-thcir-own"? 

20. Follow course schedule? 

21. Prepare for class? 
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VI. Evaluation of Student Performance 



Yes No 



1. Base tests on relevant (covered) material? 

2. Base tests on knowledge ui principles rather than memorization 0 

3. Base tests on emphasized material? 

4. Make tests too easy or difficult? 

5. Schedule quiz.zcs at regular intervals? 

6. Allow adequate time to complete tests? 

7. Comment on (correct) returned papers, quizzes, etc. 0 

8. Excuse high average students from final? 

9. Permit extra work to improve grade? 

10. Disregard lowest test score in grading? 

1 1. Use same tests svery quarter? 

12. Refuse to explain grading system?* 

13. Tell how students arc to be graded? 

14. Curve grades cither: 

a To compare individual performance with class performance? 

b. To reduce student grades? 

15. Return all papers and quizzes? 

16. Gradcallquizz.es and assignments? 

17. Give makeup tests at individual convenience? 

18. Grade on such things as major, sex, atrlcte, etc.?* 

19. Grade on class attendance?* _ 

20. Give final grades in accord with test scores?* 

21. Grade on final exam only? 

22. Pass/fail a predetermined percentage of the class'' _ 

23. Try to have makeup tests excessively difficult ' 

24. Change a clearly unfair grade?* 

25. Consider effort, participation, application in assigning final grade 1 

26. Use student to grade work? 

VIL Interest in Job of Teaching 

1. Make derogatory comments about teaching? 

2. Make derogatory comments about the course ? 

3. Indicate he would rather consult and/or do research than teach 0 

4. Criticize fellow teachers? 

♦This item would have to be answered after the student received his final grade. The major difficulty 
here would be administrative, mat is, submitting the ijucMiun to student after the course is over and 
having it returned A suggestion might be lo giv: students the question^ during the final examination 
and ask them to complete and return the form after llk> have received their t.nal grade. Returns and 
their representativeness arc problematical. 



Soirtc William W Ronan, llvuluatinn t oUege I loAsroom it* hins Ijja tm n* >. U'Rl l 1 Report \u 3 \). (\\ dshmgUm, IX" 
US Govcmmcni taming Office, l ( >72),pp 23-25 
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A President's Perspective: A Rationale and Strategy for 
Building a Performance Appraisal Program 



Richard J. Federinko 



During the past ten vears, community college administrators have been forced to 
deal with a complex array of problems principally associated with a shifting emphasis 
from growth to quality. Consequently, the challenges facing college administrators 
today have never been greater. Faced with declining or fluctuating enrollment patterns, 
diminishing financial resources, increasing expenditures associated with rapidly 
advancing technological changes, and pressing needs to provide a significant leadership 
role in economic development activities, community colleges are being asked to 
accomplish more with less with greater efficiency and effectiveness. As a result, insti- 
tutions must implement management s> stems and parameters which provide for greater 
accountability through effective planning, managing, and evaluating J 

Accountability is not a fad or "buzz:" word that is going to fade away. Elected offi- 
cials at all levels, as well as their constituents, are demanding increased focus upon 
what is necessary, valuable, and productive. The focus and growing pressure on public 
institutions for greater accountability has resulted in an ever-increasing emphasis to 
examine mo r e closely the quality of institutional programs and services. However, 
institutions cannot be held accountable, only individuals. Thus, growing numbers of 
states are requiring some form in serious performance appraisal strategy for public 
education employees. 

Since accountability is an issue that is here to stay, the time has arrived for the 
community college leaders of this country to take a serious appr'Mch to developing 
effective, pericdL, systematic, and comprehensive appraisal programs. Such programs 
must be based on clearly articulated criteria and must be legally defensible. Further, the 
appraisal process should take a positive approach as a professional development aide. 
No one employee should be excused, and no one should be treated differently. 

The major reason for performance appraisal focuses on its use as an important tool 
in building institutional excellence and accountability. This would seem to be reason 
enough. It is not, considering the ideal of self regulation. Do we want to maintain the 
prerogative of managing this activity or do we w nit someone to do it for us or to us? 
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As has been well stated by John Kingdon, "If voifre not ready to paddle when the big 
wave comes along, ycfre not going to ride on it.": i| lc objective of tin* chapter is to 
present a strategy for developing and implementing a performance appraisal program in 
a postsecondary institution. The following material draws heavily on the experience of 
Southern Union State Junior College to demonstrate how a rather significant endeavor 
of this nature can be accomplished. 



Assumptions About People 

Writing in the late 1950s, Douglas M. McGregor was one of the first writers to 
suggest that administrators who hold different assumptions about people in their organi- 
zations will behave differently toward them as well. This, of course, is the baMS for 
McGregor's famous set of assumptions known as Theory X and Theory Y.3 

Recall that if administrators feel subordinates are lazy, indifferent, and uncoopera- 
tive, they will treat them that wa>. Conversely, if it is assumed that their subordinates 
are hard- working open-minded, and interested in achieving organizational objectives, 
they will treat them quite differently. The irony is that consistent with reinforcement 
theory, people will tend to live up to expectations, in other words, treat people as losers 
and they will begin to act like losers. McGregor called this result a self-fulfilling 
prophecy. 

While McGregor's work is almost 30 years old and has received some criticism, 
the real value is that an administrator influences a situation by his/her assumptions 
about neople. A number of other researchers have demonstrated the effect that expec- 
tations and environmental pressures have on human behavior. In particular, researchers 
such as John Rouechc and George Baker recommend shifts from rigid, traditional forms 
of government to models of governance which are more humanistic and create a work 
environment that is caring and ni.rturing.4 Leadership assumptions and governance 
styles clearly impact upon employee performance. 

In regard to performance appraisal, the administration would do well to provide a 
positive governance style which assumes that people want to do a good job and will not 
only accept performance appraisal, but will demonstrate a high degree of cooperation in 
carrying out a program to which they become committed. Therefore, adopt the Theory 
Y assumptions. There is nothing to lose and a great deal to be gained. 



Coping With the Literature 

As would be the base with any major endeavor, it is a good idea to review the pub- 
lished research on performance appraisal. Several words of caution are in order. First, 
the amount of literature on the subject is overwhelming. It is simply impossible to read 
and understand ail the valuable articles, books, and monographs that have been 
published in the past 5 to 10 years alone. If the sheer volume is not problem enough, 
many of the findings are discouraging. In fact, many studies conclude that little 
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progress has been made in developing an efficient, ^ost effective, and psychometncally 
sound technique of performance appraisal. 5 

Consider, however, a different perspective. There are feu, if any, other adminis- 
trative functions and processes in which there are proven methods. In fact* the state-of- 
the-art in management is just as much a "jungle" as when Harold Koontz wrote his 
classic article. 6 But that doesn't seem to stop us in other activities. For example, the 
personnel selection process has the most far reaching consequences of any activity in 
administration. No researcher has ever devised a "perfect" selection test for any job; the 
best predictors of job success are onl> slightly better than chance. Yet we hire people 
like we know what we are doing. In fact, we also pay, promote, and develop people 
based on imperfect theories. 

This is not to disparage the literature. Revuw it bui do not be intimidated by it. 
There are a numb-r of behavioral and outcome concepts and techniques that have been 
shown to work reasonably well. In fact, such authorities as Redfern and Scriven have 
developed models for public school .systems and much of their work is useful in post- 
secondary education.' 7 There arc otiier methods such as trait rating scales, unstructured 
and impressionistic systems, and other non-job-ielated approaches which work poorly, 
if at all. An examination of the different approaches should lead to a program that best 
fits the needs of the institution. 



Overcoming Fears and Apprehension 

All members of the institutional community need to be sold on the performance 
appraisal program. Participatory management is itself a long-term performance strat- 
egy; on the other hand, a "top down" view invites failure. 

One essential feature is an administrative mechanism for higher levels of manage- 
ment to review performance ratings, reinfon id by an appeals procedure. A committee 
or group should be established to adjudicate disputed ratings ind the group should 
include peers. The appeals procedure is particularly important in cases of demotion, 
suspension, or discharge for poor performance. It is also necessary to hold free and 
open discussions with all segments of an institution. It is at forums such as these that 
fears can be allayed and apprehensions addiessed. These come in the form of the 
inevitable "what if?" questions and almost always involve a worst case scenario. It is 
usually possible to turn these negatives around. For example, an instructor might ask, 
"What if my department chair gives me a low rating because he dislikes me?" It can be 
pointed out that the rating criteria represent items that can be observed or measured, and 
that the department chair will be rated on how well he/she observes and measures per- 
formance. In fact, it can be clearly shown that a good performance appraisal system 
makes it difficult to award ratings on likes and dislikus, it is in the absence of such a 
system that biased ratings are likely to occur. 

Superiors are often concerned that subordinates will resent being given low ratings 
on those aspects of the job where performance is deficient or will be uncooperative and 
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resist performance appraisal altogether. The answer is that some people ate difficult, 
but they are probably that way long before performance appraisal was instituted. The 
performance appraisal process itself provides a means to address certain aspects of 
these problems. Moreover, most administrators will agree that dealing with difficult 
people is a fact of organizational life and comes with the job. It is also useful to ask 
superiors to review their own assumptions about people to avoid McGregor's self-ful- 
filling prophecy. 

Finally, it will probably be necessary to address the concerns of professional asso- 
ciations and possibly unions. These organizations may view with suspicion an admin- 
istrative activity which might be used to threaten job security or undermine well estab- 
lished seniority systems. While it may not be possible to gain their wholehearted 
endorsement of performance appraisal, it is best not to adopt a confrontational 
approach. At a minimum, be willing to "meet and confer" and establish as much 
common ground as possible. Keep in mind these organizations also have a stake in the 
accountability issue and face the same pressures felt by institutional administrators. 

For everyone concerned, the best approach is to promote a positive climate of 
mutual trust. Most superiors want to be fair, and most subordinates will accept honest 
ratings. The key is a well respected concept of common law known as "good faith and 
fair dealing." 



Using Consultants 

Most two-year colleges will require some outside assistance to develop an effective 
and legally defensible performance appraisal program There are a number of po^ule 
sources. These might include the state department or uvision of postsecondary educa- 
tion, extension units and/or faculty members of major universities, and private consul- 
tants. At Southern Union we contracted with a nearby university which assembled a 
team of faculty members and graduate students representing several disciplinary areas: 
counseling, industrial psychology, foundations of education, educational administration, 
and management. 

In assembling resources to undertake such a project, the following steps should 
prove useful: 

• Identify potential internal resources from the faculty and administration. 

• Appoint a project coordinator. 

• Conduct a needs assessment and determine the expertise required. 

• In selecting consultants, identify if possible persons with both professional 
expertise and successful experience in an educational setting. 

Even if all or most of the technical assistance is obtained from consultants, it is 
neither necessary nor desirable to relinquish control of the project. A "lock and key" 
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job by "outside experts" will have little credibility with the administration and support 
staff and practically none with the facult>. It is the institution, not the consultants, who 
have to live with the results. 

Before the start of the project, hold a round table discussion with the consultants. 
Discuss with them the purposes you intend to accomplish, the funds available, services 
the institution will provide, documentation to be provided, pilot testing, suggested 
methods and techniques for various job families, follow up activities such as rater 
training, validity studies, legal defense (expert witness) evaluation, and similar issues. 
Moreover, recognise that an undertaking of this magnitude will not be completed within 
a short time-frame. Participatory type involvement requires time and an abundance of 
patience. 

Who is Covered 

The major goal in performance appraisal should be to access individual work 
related contributions within the total institution-not just the faculty, nor the administra- 
tion, nor the support staff. A performance appraisal program should be for everyone, 
beginning with the president. There should be, of course, different procedures for dif- 
ferent job families. The performance of a dean is measured in terms of outcomes such 
as goals achieved and expectations met while the performance a library technician is 
expressed in terms of appropriate job- related behaviors. But in the final analysis, each 
person's performance is rated against a standard. 

While there is disagreement in the literature on rating formats and rating scales, it 
is necessary to develop appropriate instrumentation. At Southern Union there are three 
subsystems, however, they each follow the same rules of combination and produce a 
rating on a 5-point scale. Thus, a department chair, instructor, and custodian who 
receive an overall rating of "3.5" are performing at the same level, albeit in vastly 
different roles. 

Legality 

When used as input to decisions such a^ retention, promotion, and merit increases, 
performance appraisal results have important legal implications. Even when used only 
for developmental purposes, it might be difficult to establish the fact that ratings have 
no bearing on administrative decisions. People are protected by federal laws and court 
decisions from discrimination based on race, color, sex, religion, national origin, age, 
physical handicap, and Veteran status. Moreover, the common law doctrine of 
employment-at-will has been significantly eroded in state courts. Therefore, it is 
extremely important that the performance appraisal s>stem be validated in accordance 
with appropriate regulations. 8 

While no performance appraisal system can be made grievance proof or immune to 
litigation, a properly designed validity study is an essential document v hen and if per- 
formance ratings are called into question by a regulatory agency or a court. The study 
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should address such critical issues as job analysis, criterion development, instrumenta- 
tion, procedures, and purposes Without evidence of validity, even systems designed by 
"experts" are likely to be rejected by the courts. 



Management Support 

When beginning the implementation pha^e of a performance appraisal program, 
often the president or another administrator makes appropriate comments at a convoca- 
tion or issues a letter pledging his/her support. All this is tine if preceded by intimate 
involvement in the developmental phase and followed by a demonstrated personal 
commitment. If performance appraisal is to be taken seriously, managers and supervi- 
sors at all levels of the institution must be conscientiously involved. In fact, how well 
they accomplish this task should be reflected in their performance ratings. 

Shakedown Administration 

No matter how competent and professional the team that developed the program, or 
how high the level of management support, or how deeply involved were the faculty 
and staff from its inception, there will be problems in implementation. Behavioral 
anchors which were clear and concise when w ritten and reviewed by 15 people in ihree 
levels of the organization will suddenly become vague and ambiguous. Rater errors and 
tendencies which were fully covered during rater training sessions will proliferate and 
several new ones will emerge. Carefully designed weighting systems and rules of com- 
bination will come apart when the same people who signed off on the job analysis data 
point out that the criteria do not match their work assignments. When the dust settles, it 
will be disco-, ered that the problems are not that serious and can be corrected without 
fundamental changes. The time to make these refinements, however, is during a shake- 
down administration or "dry run." It is not when the ratings are to be used for adminis- 
trative decisions. 



Concluding Remarks 

Designing, developing, and implementing an effective performance appraisal 
system is not an easy task. In fact, the Southern Union process at times could have been 
described as difficult, confusing, controveisial, and time-consuming. But, "difficulty 
and confusion" were addressed early from the process by retaining individuals with pro- 
fessional expertise in implementing a sophisticated, comprehensive appraisal system. 
"Controversy" was mitigated through total institutional commitment, involvement, 
negotiation, and communication. As far as the "time-consuming" aspect of the process, 
this is one factor which simply cannot nor ever will be eliminated. In fact, maintenance 
of the appraisal process at Southern Union continues to be time-consuming. Effective 
performance appraisal systems require continuous refinement and modification because 
position descriptions will be rearranged, errors will be found, new positions will evolve, 
and humans will change for the sake of change. Change, therefore, is a necessary 
ingredient in the evolution of an effective system of appraisal. 

O 



A President's Perspective 109 



At Southern Union, the "high road" to developing and implementing a performance 
appraisal system was taken. A genuinely open and positive environment was created, 
disagreement was expected, negotiation was required, and individual participation by 
everyone was necessary. Through total institutional commitment, a very positive out- 
come was achieved. But more important, Southern Union wisely invested in the posi- 
tive development of its greatest resource, its individual employees. Its employees are 
consequently highly motivated, achievement-oriented, and committed to accountability. 
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Characteristics of Effective and Legally Defensible 
Performance Appraisal Systems for Postsecondary Education 

Betty e B. Burkhalter and James A. Buford, Jr. 



Performance appraisal continues to be one of the most important responsibilities of 
administrators in postsecondary institutions. It increasingly is becoming a legal prob- 
lem; the growth of federal laws and regulations has created specific rights for faculty 
and staff in their relationship with their emplo>ers. Characteristics of a performance 
appraisal system that accurately measures job contributions and is completely 
defensible in today's legal environment continue to be a matter of debate. Such a 
system may not exist. However, incorporation of the following will minimize many of 
the most common legal problems and lead to a more effective system. 

1. Needs Assessment and Planning. An institution that is considering perfor- 
mance appraisal should decide in advance what the program is intended to accomplish. 
Uses of performance ratings might include input to placement, promotion, compensa- 
tion, development, and termination decisions. Onl> after the purpose is clearly estab- 
lished and the specific requirements are decided upon is the organization in a position to 
develop a performance appraisal program. 

2. Participation. Research clearl> has shown that work is a motivator and that 
most people want to do a good job.' A well respected philosophy is that the authority in 
an organization is delegated upward. Thus, it makes intuitive sense that people at every 
level need to participate in the development of a performance appraisal program. If 
they do not, it will be very difficult to gain their understanding and support during 
implementation. 

3. Job Analysis. The cornerstone of the development of a performance 
appraisal system is job analysis.^ When an employment practice is to be defended on 
the basis of content validity, the job analysis establishes the rational link between 
factors used in appraisal and the critical work behaviors of the job. 4 Two comprehen- 
sive reviews of characteristics of performance appraisal systems related to court 
decisions found that where job analysis was performed, courts ruled in favor of the 
defendants in approximately 82 percent of the cases. Without job analysis, defendants 
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lost everj case.* Job analysis should be conducted when duties are reasonably stable so 
that conditions will be comparable to those which will exist when the performance 
appraisal instrument is used. 

4. Performance Criteria. While traits such as initiative, enthusiasm, attitude, 
and loyalty are important to job performance, most often they are not suitable as 
performance criteria.* 7 It is better to develop criteria which describe observable job 
behaviors or outcomes. Even w hen the possession of a trait can be show n as critical for 
effective job performance, it is usually possible 10 design an observable measurement 
based on how job duties actually are performed. 

5. Appraisal Instruments. The various instruments should facilitate the admin- 
istration of performance appraisal under standardized and controlled conditions. 8 
Instruments should be designed carefully to accommodate both the criteria and method. 
If several criteria or scales are to be combined, the instrument should produce a com- 
posite rating based on the rules of combination. 0 Appropriate identification, comments, 
and signatory sections should be included. 

6. Reliability and Validity. To achieve the organization's purpose of accurately 
measuring performance and to satisfy legal requirements, the appraisal system must be 
valid; it must measure what it purports to measure. First, however, the system must be 
reliable. The ratings must yield stable and consistent results from one period to the next 
and across all items. in . Reliability and validity studies should be conducted to meet 
technical standards of the "Uniform Guidelines on Employee Selection Procedures" and 
documented in a written report. 11 

7. Testing the System. Prior to implementation of performance appraisal, a 
review should be conducted to ensure that the process selected supports overall objec- 
tives and will provide the needed information flew to such decision areas as compensa- 
tion, placement, and professional development. In many cases it may be necessary to 
conduct a pilot or "shakedown" test of the system to identify and address problem areas 
and work out procedural matters. 12 

8. Communication of Policy and Purpose. The purpose and uses of perfor- 
mance appraisal should be stated clearly in the organizational policy as well as in the 
employee or faculty handbook. Procedures should be developed to cover which 
systems will be used for w hich jobs or job families, how often appraisals are to be con- 
ducted, documentation required, recourse, and similar matters. Fully informing all 
individuals of policies will minimize uncertainty and resistance and will increase the 
probability of positive results. 13 

9. Rater Training. In many organizations, the task of observing and measuring 
job performance is poorly carried out. Research has indicated that rater training is more 
important than design considerations in improving accuracy of performance appraisal. 
Training programs should focus on improving rater skills in observing, recording, and 
appraising behavior with less emphasis given to such issues as rating distributions and 
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staistical measures.** Extremely good results have been obtained with training pro- 
grams designed to build observational skills and reduce such common problems as halo 
effect, first impressions, patterns of leniency and strictness, recency, and similar 
errors. 15 Raters must fully understand the critical importance of the interpersonal 
aspects of performance appraisal. They must develop skills in feedback, praise, con- 
structive criticism, and listening. Raters also must be sensitive to the situations and 
conditions faced by individuals. Finally, raters must develop skills for identifying, 
describing, and negotiating performance expectations. 

10. Administration. The most basic requirement is that the performance 
appraisal process should support the system's goals, conflicting multiple uses should be 
avoided. The system could be cost effective. Expenses should be balanced against the 
post appraisal impact on motivation and productivity.^ Performance appraisal admin- 
istration must ensure that the people who are being rated understand the mechanics, 
including such issues as performance expectations, how ratings on various criteria will 
be weighted, and who will actually conduct the appraisal. Finally, it is very important 
that performance appraisal be conducted by raters who have directed and continually 
observed job performance. 

11. Privacy and Due Process. The Federal Privacy Act of 1973 created the 
Privacy Protection Study Committee (PPSC), which issued a series of recommendations 
in 1977. Among these was the suggestion that employees should have access to all 
records relating to their qualifications for employment, promotion, and pay increases 
and to records relating to discipline and discharge. Many professional groups have 
recommended voluntary compliance with these recommendations. Moreover, indi- 
vidual access to records builds confidence in the system's basic fairness, provides an 
additional means of communicating results, and protects the individual's rights.is. 
Adverse performance ratings can lead to denial of merit pay and promotions in some 
cases, dismissal. Due process refers to a systematic, orderly procedure where an indi- 
vidual has the opportunity to object and be heard. 19 Employee rights in this area are 
still evolving; however, courts increasingly are requiring employers to justify their 
actions.2o Legal questions aside, organizations due process is a good management 
practice. A formal appeal process should be established to provide an impartial review 
of ratings that are disputed. 

12. Audits. Performance ratings should be analyzed periodically for evidence of 
discrepancies and adverse impact. Statistical tests do not prove that raters are making 
errors or showing bias. However, properly designed analyses can highlight certain 
patterns that might not be found merely by reviewing a list of ratings. When such 
patterns appear, management should determine the cause and, if necessary, correct the 
problem-particularly when members of protected groups such as blacks and females 
receive significantly lower ratings. 

In the final analysis, the effectiveness and legal defensibility of a performance 
appraisal system will depend on its legitimacy as a tool for making employment deci- 
sions. The success of any system depends on its effective administration by all levels of 
management. A common failure of performance appraisal systems is the assumption 
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that forms, handbooks, and policy statements are just another set of procedures. No 
appraisal program, regardless of how well it is developed, will be effective or legally 
defensible unless administrators have a high level of commitment and make a continu- 
ous effort to carry out the complete process. A poor system can be made to work when 
the administrators make the effort to compensate for inadequacies in design. On the 
other hand, if a state-of-the-art system is poorly administered, it will surely fail. 
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Appendix A: Performance Appraisal Forms* 



Appendix A contains case examples of performance appraisal forms designed for a 
variety of jobs within The Alabuir: College System. The types of forms vary depend- 
ing on the different job category- support, administrative, or faculty. However, the 
basis for all appraisal instruments in detailed job analysis \vhich categorizes job duties 
into major responsibility areas, or job domains. These domans are weighted based on 
frequency and importance of dut ; es. On each performance appraisal form appropriate 
job domains are listed along with their assigned weights. A five-point rating scale is 
employed throughout, with space designated for explanatory comments. At this point, 
the appraisal approach varies, depending on the type of job. Explanations of each 
exhibit will follow. 



Lxhibits 1-4 in this appendix were developed by Anne Smyth Stewart, M.Ed., 
Counse\\, Student Development Services, Auburn University, AL 36849. Exhibit 5 
in this appendix was developed by Deborah J. Miller- Wood, M.A., Graduate Research 
Associate, Department of Educational Foundations, Leadership, and Technology, 
Auburn University, AL 36849. 
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Exhibit 1 

The job of Library Technician at Southern Union State Junior College fai* , into the 
support category. Jobs in this group are appraised using the weighted responsibility 
as as performance criteria. These are identified in Part II of the Performance 
ppraisal Form and are defined using qualifying words that state "how" a set of duties 
is performed. The performance discussion and summary in Part III deals with factors 
that impact on the overall performance and should be self explanatory. 
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PERFORMANCE 
APPRAISAL FORM 

PART 1 IDENTIFICATION 


■ 1 

1 


Southern Union State 
Junior College 


Nam* 


Rating Scale Key 


Position Library Technician 

Rating Pftnorf From Tn 

RatAr Namn 

Rater Titln 

Dftpartmnnt 

n*t« Employ m4 


01 Fails to Meet Job Requiremente 
CD Essentially Meets Job Requiremente 
CD Fully Meets Job Requirement! 
(3 Meets Job Requirements with 

Distinction 
[J] Exceeds Job Requirements 



PART II RATING SCALES FOR MAJOR RESPONSIBILITIES 



A. Physicial Processing PCT 35 % 


RATING 


i 

□ 


I 

a 


3 

a 


4 

a 


« 

a 


Crttting sod maintaining records, and correctly performing 
related tasks needed to facilitate locating and obtaining library 
insterialSj 


COMMENTS 


B. Circulation PCT 20% 


RATING 


i 

□ 


2 

□ 


3 

□ 


4 

a 


« 

a 


Carrying out prescribed procedures, and accurately maintaining 
records regarding the borrowing of books and other materials 
by library users. 


COMMENTS 


C. Acquisition PCT 15% 


RATING 


i 

□ 


2 

□ 


3 

a 


4 

a 


« 

a 


Ordering and receiving books, periodicals, and other materials, 
and accurately maintaining records 


COMMENTS 


D. Reference PCT 10% 


RATING 


i 

□ 


a 


3 

a 


4 

a 


• 

□ 


Assisting library users by providing information services, 
answering questions, assisting in locating library materials, and 
integrating information into cataloging system. 


COMMENTS 


E. Cataloging and Classification PCT 10% 


RATING 


i 

□ 


2 

□ 


3 

a 


4 

a 


• 

a 


Accurately compiling Information and properly entering 
classifications of library materials, and integrating information 
Into cataloging system. 


COMMENTS 


P. General and Administrative PCT 10% 


RATING 


□ 


□ 


3 

□ 


4 

□ 


• 

□ 


Carrying out administrative support services and activities in 
accordance with institution policies and procedures. 


COMMENTS 


G PCT % 


RATING 


□ 


2 

a 


3 

□ 


4 

□ 


< 

a 




COMMENTS 
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PART III PERFORMANCE DISCUSSION AND SUMMARY 



Does the employee report for and rer.iam at work as required? □ yes □ no If no. please explain 



Does the employee follow instructions and observe work rules? □ yes □ no If no. please explain 



Does the employee get along and cooperate with co-workers on the job? □ yes □ no If no. please explain. 



Does the employee hcve the knowledges, skills, abilities, and other qualifications needed f oi successful 
job performance? □ yes □ no If no, please explain 



Describe any specific actions employee needs to take to improve job performance 



Summarize this employee's overall job performance as determined in your joint discussion 



PART IV SIGNATURES 



This report :s oased on my observation and 
knowledge of both the employee and the job 



Supervisor Date 



My signature indicates that 1 ha^e reviewed 
this appraisal It does not mean that 
I agree with the results 



Reviewer Date Employee Date 
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Exhibit 2 

The position of Director, Instructional and Student Development, is a state level 
administrative position. The sample Performance Appraisal Form shown is similar to 
that used in Exhibit 1, with key expectations included as an added dimension. 
Weighted job domains are entered on the form and defined in performance-related 
terms. Key expectations for the rating period will have been entered from the previous 
review session when these were developed. Each of these areas is then rated against the 
five-point scale. Part III addresses factors which impact on the performance of the job 
but do not fall under specific duty statements. These are not rated on a scale; rather are 
discussed in narrative form. The remaining sections of this form are ^elf-explanatory. 
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PERFORMANCE 
APPRAISAL FORM 



Name Identification Number 

T.tie Doctor D v)Sion Instructional and Student Development 



Date Employed Dale Assigned Present Job 

Rater Name T llje 

Appraisal Period From j 0 

This Appraisal Is Annual Other 



INSTRUCTIONS 

PARTI PERFORMANCE RESPONSIBILI fY RATINGS 

The position responsibilities are taken from the job description The rater appraises .esults achieved against responsibilities/ 
expectations by checking one ol the live following degrees ™»Mwnw«niH«# 

5 - EXCEPTIONAL Performance *hich clearly exceeds work requirements and indicates an exceptional deb.re and ability to do 
more than u reasonably expected in terms of prolessiona! quality, work output, or both 

4 - VERY GOOD Performance which meets work requ rements with distinction and indicates a desire and ability to do a highly 
professional job * ' 

3 " comp^Irtpb Perf0rmance wh,ch ,ully mee,s WOrk requirements and indicates a des.re and ability to do a thorough and 

2 - MARGINAL Perfo.mance which essentially meets work rpquirements and indicates a des.re and ability to be at least adequate 

1 - UNACCEPTABLE Performance which clearly fails to meet work requirements and indicates either a lack of ability or unwillingness 
to do what is reasonably expected 

.h^ 6 !* ,h *i e . , r , '° nS ° f eaCh P ertormance responsibility including the expectations or objectives which have been established, 
men appraise the person by one responsibility at a time Om.t appraisal cn any responsibility for which you believe your observation 
^S^m^^^J^!^^ n >° X aPP ' y 1° ,h6 P6fS0n D,SreQar(J y° ur 9 erteral impression of the person and concentrate on 
the entire ratin"penod definitl0nS established Rate the person on his/her typical performance on that responsibility during 

Raters can appraise performance on those criteria which the rater has regularly and Erectly observed or where there is objective 
evidence Ratings musl be based on facts Do not be influenced by p.evious ratings While it is true that several responsibilities 
are related when you rate a person on one responsibility, you must disregard the ratings you have given him/her on other responsibilities 
r«LlZ ?T ,H h ,' Ch y° ur , a PP ra,sal ,s e,,he ' UNACCEPTABLE or EXCEPTIONAL, justify with appropriate comments In addition, 
comments should be made for any rating if they will clarify your rating 

PART II PERFORMANCE FACTORS 

Comment on each of the factors which mfluencea performance m as.,gned responsibilities Use specific examples and. as appropriate 
emphasize both streng.hs and areas needing improvement Comments should not focus on personality traits or personal habits but 
! ■ " i! y ,ransla,e ,nt0 observed behaviors in getting the job done If a factor was not applicable during the rating period. 
IVZn 11 ! C . P ert0 ' mance 'actors, while not directly rated, are important in understanding how results were achieved and 
in identifying ways to improve performance in succeeding periods 

PART III SUMMARY PERFORMANCE STATEMENT 

The Summary Performance Statement is a key part of the performance appraisal It should summarize the overall resulis. the 
manner in which results were achieved, any special conditions which existed, and the trend of performance 
PART IV STAFF MEMBER'S COMMENTS 

In this section, the sta^ member should be encouraged to make specific comments on any aspect of his/her performance appraisal 
PART V SIGNATURES 



.h^ 0,,0 k WI k 9 ,he , per,0rmance apP'aisal discussion, the rater and staff member will s.gn the appraisal form It will then be forwarded 
through channels to the Chancellor for review and signatures 



1 ri 
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PART I PERFORMANCE RESPONSIBILITY RATINGS 



Enter performance responsibility areas from job description and include relative importance Enter 6 andards. objectives, or other 
expectations for the rating period Make comments on observed job behaviors and results achieved Rate performance based on 
definitions provided 



A Administration (25%) Effectively analyzing the situation fo r the Division, setting goals, and developing policies, operating 
plans, and assignments, submitting accurate, timely reports 


KEY EXPECTATIONS FOR RATING PERIOD 


COMMENTS 

1 2 3 4 5 
RATING □ □ □ □ □ 


B Instructional Programs (20%) Providing instructional leadership for the system through coOidmatiOn of Division staff and 
task forces m curriculum development and design, standardization of courses, competency-based instructional approaches 
and program evaluation 


KEY EXPECTATIONS FOR RATING PERIOD 


COMMENTS 

1 2 3 4 5 
RATING □ □ □ □ □ 


C Supervisor/ Management (20%) Selecting, training, and appiaismg staff directing the activities of subordinates toward 
the accomplishment of objectives, and promoting efficiency 


KEY EXPECTATIONS FOR RATING PERIOD 


COMMENTS 

1 2 3 4 5 
RATING □ □ □ □ □ 


D Liaison and Special Services (15%) Effectively representing the Chancellor and the department m official matters, 
performing other related services as assigned 


KEY EXPECTATIONS FOR RATING PERIOD 


COMMENTS 

1 2 3 4 5 
RATING □ □ □ □ □ 


E Faculty/Staff Policies and Development (10%) Developing and maintaining policies for faculty /Staff at all institutions, 
providing opportunities and a structure thiough which instructors tan increase or imptove credentials, skills and abil.ties 


KEY EXPECTATIONS FOR RATING PERIOD 


COMMENTS 

1 2 3 4 5 
RATING □ □ □ □ □ 


F Student Services (10%) Providing leadership foi student services thiough the professional staff of the Division and 
through student services departments at each institution 


KEY EXPECTATIONS FOR RATING PERIOD 


COMMENTS 

1 2 3 4 5 
RATING □ □ □ □ □ 
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KEY EXPECTATIONS FOR RATING PERIOD 


COMMENTS 

12 3 4 5 
RATING □ C □ □ C 




KEY EXPECTATIONS FOR RATING PERIOD 


COMMENTS 

1 2 3 4 5 
RATING C G □ □ C 


PART II PERFORMANCE FACTORS 

behaviors ^ °' ^ faCt ° rS ' n,luenced P er0rmanCe of assigned responsibilities and how they translated into observed 


FACTOR 


CO M M E NT S 


Self Development and Appraisal . Hew effectively this person 
analyzes own performance, strengths and weaknesses accepts 
constructive cr tidsm. participates m relevant education 
experiences, reads job-related literature, keeps up-to-date on 
new trends and developments and improves capabilities to meet 
changing job requirements 




Administrative Skills • How effectively this person recognizes 
pno'ities. formulates schedules, establishes work objectives 
understands or defines responsibilties. projects work needs 
organizes the work to be performed and in general avoids 
"crisis" types of activities 




Interpersonal Relations - How effectively this person interacts 
with superiors subordinates peers and external contacts in 
both favorable and unfavorable or conflict situations 




Oral Communications - How effectively this person verbally 
communicates information including using appropriate 
language, listening, overcoming barriers and obtaining 
feedback in Situations involving either information transfer or 
persuasion 




Written Communications - How effectively this person produces 
written material which is clear concise, expressed m a logical 
and direct manner, correct m grammar and spelling, and 
presented m the appropriate format and style 
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PART III SUMMARY PERFORMANCE STATEMENT 

Summarize overall results manner m which results were achieved speuai conditions under wh.cr performance occurred developmental 
needs and trend ol performance 



PART IV STAFF MEMBERS COMMENTS 

Please use the space below to comment on any aspect of your performance appraisal 



PART V SIGNATURES 



Rater 



Signature Title Date 

Staff Member 



' have reviewed and discussed this performance appjdisai with my superior I am aware that I have the opportunity to 
comment on this performance appi aisal m writing and that my comments will become part of the record of this performance 
appraisal 



Signature 


Title 


Date 


Reviewers 






Signature 


Title 


Date 


' jni: re 


Title 


Date 



X J 
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Exhibit 3 

There are two forms used for the administrative position, Dean of Instruction. In 
the document entitled Performance Standards, each domain is broken down into sub- 
criteria for which performance standards are developed. These are written at the "meets 
standards" level as an anchor for the performance rating. The degree to which 
standards are met, exceeded, or not met will determine the rating assigned on the 
document entitled Performance Appraisal Form. For administrative positions at this 
level, setting annual objectives and assessing results are key parts of performance 
appraisal. Parts III and IV allow for future planning and for assessment of the previous 
year's objectives. The appraisal summary in Part V encourages a developmental, 
positive approach in discussing employee strengths and possible areas for improvement. 
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PERFORMANCE 
STANDARDS 




Job Title: Dean of Instructi on 



Department: Administration 



Junior College 



Job Domain 



Performance meets standards when 



A Planning (20%) 



B Organizing (10%) 



C Staffing (10%) 



D Leading and 
Directing (25%) 



1 Long-Range Plans Analysis is made of situation and needs, 
measurable objectives are established, and appropriate plans are 
developed. 

2 Policies and Procedures Written policies, directives, handbooks, and 
procedures are developed and communicated in all academic and 
areas 

3 Academic Calendar and Schedules All day and night programs, 
including off-campus centers, are scheduled in a cost-effective 
manner, with consideration for space utilization of students and 
qualifications and preferences of faculty members 

4 Budget Development of academic budget is accomplished based on 
appropriate guidelines and submitted on or before deadline, adequate 
budgetary control procedures are established 

5 Accreditation Action plans are developed to meet or maintain 
accreditation standards of the Southern Association of Colleges and 
Schools (SACS) and other accrediting agencies 

1 Organizational Structure Academic organizational structure is 
developed and implemented Organization facilitates accomplishment 
of objectives 

2 Committees Approp'iate standing and ad hoc committees are 
established and charged Committees carry out prescribed functions 
and make scheduled reports 

1 Planning and Analysis Adequate human resource planning for 
academic program is accomplished, all jobs are periodically analyzed, 
and comprehensive job descriptions are maintained 

7 Personnel Functions Recruiting, selection, development, appraisal, 
and compei isation functions for academic, administrative, and support 
positions are carried out in accordance with prescribed procedures 

3 Legal Requirements All personnel procedures are validated in 
accordance with current EEO laws and guidelines 

1 Overall Leadership Policies, procedures, rules, directives, and 
instructions are clearly communicated to subordinates at all levels, 
administrators, chairpersons, and supervisors at all levels use 
interpersonal influence, lead by example, and promote teamwork, a 
climate is established where academic administrative staff and faculty 
are motivated in work toward objectives, developing problems are 
identified and expeditiously resolved at lowest possible level in 
organizational structure, and progressive discipline is used, employee 
rights to due process are protected, and procedures are followed 
in all cases 
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E Controlling and 
Reporting (20%) 



F External 
Affairs (10%) 



G Professional 

Development (5%) 



Concurrent Control Key indicators of performance are established 
and activities are monitored in all academic areas, corrections are 
made where necessary 
Feedback Control Accomplishments are compared against plans and 
standards at end of performance/budget cycle Analysis is made of 
any failure to accomphsh planned results and appropriate action is 
taken 

Reports All regular and special reports are accurately prepared and 
submitted on time Information from reports is analyzed and used 
in planning process 

Public Relations Good public relations are maintained with 
community, legislative delegations, and other educational institutions 
to encourage maximum contribution by external groups to college 
objectives 

Representation A positive image of the college is projected 

Credentials Incumbent holds appropriate terminal degree 
Self-Development Adequate current knowledge of professional 
matters is maintained through attendance of meetings of professional 
associations, journals, workshop attendance, and personal study 
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PERFORMANCE 
APPRAISAL FORM 

PART I IDENTIFICATION 



Name 



Position Dean of Instruction 



Rating Period From . 

Rater Name 

Rater Title 

Department 

Oate Employed 



SU 



Southern Union State 
Junior College 



Rating Scale Key 



LTI Fsils to MMt SUndtrdt 

ID Essentially Mt*tt Sundtrdt 

HI Fully MMtt SUndtrdt 

H Mcttt SUndtrdt with Distinction 

® Excesdn Stsnrtards 



PART II RATING SCALES 



Performance Standards For 

A Planning 

1 Long-Range Plan? 
2 
3 



Pet _?0% 



Policies and Procedures 



Academic Calendar and Schedules 



Budget 



5 Accreditation 



Rating 



□ 
□ 
□ 
□ 
□ 



□ 
□ 
□ 
□ 
□ 



□ 
□ 
□ 
□ 
□ 



□ 
□ 
□ 
□ 
□ 



Comments 



Performance Standards For 

B Organi zing 



Rating 



Comments 



Pet 



Committees 



1 Organizational Structure 
2 
3 
4 
5 



2 
□ 
□ 
□ 
□ 
□ 



4 

□ 
□ 
□ 
□ 
□ 



5 

□ 
□ 
□ 
□ 
□ 



Performance Standards For 

C Staffing 

1 Planning and Analysis 
2 
3 
4 



Rating 



Pet 



Personnel Functions 



Legal Requirements 



1 

□ 
□ 
□ 
□ 
□ 



2 

□ 
□ 
□ 
□ 
□ 



5 

□ 
□ 
□ 
□ 
□ 



Comments 



Performance Standards For 

0 Leading a jidj^recting 

1 Overall Leadershi p 

2 
3 
4 
5 



Pel 



Acade mic Prog ram 



I 

□ 
□ 
□ 
□ 
□ 



Rating 



2 3 4 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 



6 

□ 
□ 
□ 
□ 
□ 



Comments 
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Performance Standards For 
E. Control lirm and Reporting 

1 -Concurrent, Control 

2 
3 
4 
5. 



Pet 



15c 



Feedback Control 
-Reports 



Performance Standards For 

F External Affairs 

1 Public RnlflliflDi 

2 Representation 

3 

4 

5 



Pet JO % 



Rating 



1 

□ 
□ 
□ 
□ 
□ 



2 3 4 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 



Rating 



Performance Standards For 
G Professional Development 
1 Credential! 



Pet _JL% 



2 Self-Development 

3 

4 . 

5 



□ 
□ 
□ 
□ 
□ 



2 3 4 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 



5 

c 
□ 
□ 
□ 
□ 



Rating 



1 

□ 
□ 
□ 
□ 
□ 



2 3 4 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 



5 

□ 
□ 
□ 
□ 
□ 



Comments 



Comments 



Comments 



PART III OBJECTIVES 



Key End Result 



Measure 



Performance Assessment 



Key End Resell 


Measure 






Performance Assessment 



9 

ERIC 



Appendix A 133 



Key End Result 


Measure 






Performance Assessment 




Key End Result 


Measure 






Performance Assessment 


PART IV OBJECT!VE3 NEXT review period 


Key End Result 


Measure 








Key End Result 


Measure 








Key End Result 


Measure 








Key End Result 


Measure 
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PART V DEVELOPMENTAL APPRAISAL SUMMARY 



PART VI SIGNATURES 



This report is based on 








my observation and 








knowledge of both the 




My signature indicates that 




employee and the job 




1 have reviewed this appraisal 








It does not mean that 1 agree 








with the results 




Supervisor 


Oate 










Employee 


Date 


Reviewer 


Date 






CopynghU 1985 by J A Butord Ji 


B 8 Burkhaitef and Auburn Un 


versily Auburn AL 36849 All rights reserved 
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Exhibit 4 



An expanded approach is used for the Faculty, position at Southern Union State 
Junior College, with Obsenation Stales to be used in conjunction with the Perfor- 
mance Appraisal Form. In this case, descriptive statements are written to reflect typical 
behaviors at each level on the five-point scale rather than just at the number 3, "meets 
standards" level. Therefore, a department head completing this form on a faculty 
member will need to read through the scales for each criteria to locate the description 
best suited to the observed performance. Parts IV and V of the Performance Appraisal 
Form are self-explanatory. 
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Southern Union State 
Junior College 
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A. Instructional Planning and Preparation 

1. Course Development - Researches literature in subject area, develops and main- 
tains course outlines, selects textbooks and other teaching aids. 

5 Exceptional Assumes a leadership role in divisional planning meetings and 
other aspects of curriculum development, suggesting additional 
course offerings and/or modifications in current offerings. Care- 
fully researches literature and attends workshops focusing on 
curriculum/course development, learning resources, and subject 
area matters. Serves as a resource person in subject area and 
offers suggestions to colleagues regarding textbooks and other 
learning resources. 

Takes an active role in divisional planning meetings regarding 
curriculum or course development. Researches current literature. 
Shares information with colleagues. Updates course outlines and 
suggests ways to optimize format of course outlines. 

Shares responsibilities in divisional planning meetings regarding 
course development. Prepares each quarter written course out- 
lines (syllabi) for courses taught, incorporating recent develop- 
ments in subject area and current methods of instruction. 
Submits outline on time to Dean's office. Makes suggestions re- 
garding textbooks and other teaching aids. 

Attends divisional planning meetings and participates without 
taking direct responsibility. Submits course outline to Dean's 
office with minimal or no changes from previous years. Provides 
support for others' suggestions regarding textbooks and other 
teaching aids. 

/ Unacceptable Misses or irregularly attends divisional planning meetings. 

Assumes minimal or no responsibility for completing course out- 
lines. Demonstrates limited interest in using textbooks or other 
resources. 

2. Instructional Planning - Makes necessary preparations for classroom lectures, 
demonstrations or laboratory presentations. 

5 Exceptional Develops, maintains, and previews additional resources, such as 
films or tapes for reference, timing, and quality. Utilizes a 
variety of teaching methods and aids. Promotes sophisticated 
inquiry techniques and provides problem solving experiences 
emphasizing key concepts. Instructional time is optimally 
planned for benefit of students. 



Hi 



4 Very Good 



3 Acceptable 



2 Marginal 
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4 Very Good Develops detailed notes and guides. Presentations are well 

planned emphasizing key concepts. Comprehensively integrates 
lecture, etc. with textbook and/or other curricular materials. 
Instructional time and variety of material is planned for benefit of 
students. 

3 Acceptable Develops outlines and notes to ensure that key concepts are 

emphasized; that textbooks and other materials are integrated. 
Instructional time is wisely used. Comes to class prepared with 
necessary materials for classroom instruction. 

2 Marginal Reviews topic(s) to be covered. Outlines presentation or instruc- 

tional activity so that instructional time is not wasted. Usually is 
prepared with materials necessary for class instruction. 

1 Acceptable Reflects minimal or no preparation in instructional performance. 

Primarily relies on textbook, outdated notes, and/or student input 
for class content. Arrives at class unprepared without instruc- 
tional materials necessary for presentation. 

Clinical Preparation (Nursing) - Provides for efficient and etfective utilization of 
the clinical facility and staff. 

5 Exceptional Meets regularly with clinical staff or head nurse to promote a 

productive working relationship. Respects all levels of clinical 
staff. Exhibits interest and implements strategies to improve and 
facilitate optimal clinical experiences for students. Carefully 
assesses how each student's learning needs are being met by 
clinical experiences and arranges for modifications as necessary. 
Possesses thorough knowledge of facility's system, routines, 
procedures, and regulations. 

4 Very Good Maintains frequent contact with facility staff to ensure positive 

working relations. Is sensitive to the reciprocal relationship 
between the clinical facility and nursing program. Actively 
follows student progress within program. Respects and follows 
facility's routine, procedures, and regulations. 

3 Acceptable Maintains adequate communication with facility staff. Monitors 

studem ' progress within program. Knows and follows facility's 
routine, procedures, and regulations. 

2 Marginal Communications are limited with facility staff. Follow* through 

with experiences planned by course coordinator. Seeks assis- 
tance or information from staff on occasion regarding facility's 
routine, procedures, and regulations. 
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1 Unacceptable Communications are rare with facility staff. Lacks a working 
knowledge about facility's routine, procedures, and regulations. 
Fails to seek or consider feedback from students on effectiveness 
of clinical experiences. 

4. Clinical Planning (Emergency Medical Technician-EMT) Plans experiences 
and assignments within clinical facility. 

5 Exceptional Acts as a facilitator to clinical staff to update plans for clinical 
experiences. Researches to discover innovative ways to improve 
and further facilitate positive clinical experiences for students. 
Carefully assesses how each student's needs are met through the 
experiences and assignments completed in the facility. Modifies 
experiences or assignments of students as deemed necessary. 

Maintains frequent contact with clinical supervisor to ensure 
productive working relationship. Is sensitive to the reciprocal 
relationship between the facility and the program. Monitors 
student progress throughout the quarter by encouraging feedback 
from supervisor on student performance and experiences. 
Encourages input from students on possible improvements in 
clinical experiences. 

Holds necessary meetings with supervisor in clinical facility to 
plan assignments, experiences, and schedules in order to promote 
students' development and attainment of course objectives. 
Monitors student progress throughout the quarter. 

Maintains minimal communications with supervisors in clinical 
facilities. Plans for students' clinical experiences, but relies 
predominantly on the facility staff to dictate experiences. 
Usually schedules appropriate assignments. Accepts student 
feedback on occasion. 

1 Unacceptable Communicates rarely with supervisors in clinical facilities. Fails 
to plan appropriate clinical experiences or relevant assignments. 
Discourages student feedback in clinical activities. 

B. Instruction 

1. Schedule and Attendance - Teaches classes as scheduled or requested, and 
encourages and records class attendance. 

5 Exceptional Rarely fails to meet class. Begins and ends class promptly to 
ensure for maximum instruction time. Conducts class for entire 



4 Very Good 



3 Acceptable 



2 Marginal 
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scheduled time. Adheres strictly to college's policy on atten- 
dance and records absences daily. Willingly accepts teaching 
assignments and responsibilities as scheduled. 

4 v eryGood Almost always meets class for full time period. Arrives early to 

class to ensure that instruction can begin on time. Encourages 
attendance throughout the quarter and records daily attendance. 
Willingly accepts teaching assignments as scheduled. 

3 Acceptable Usually meets classes. Reminds students of attendance policy. 

Records daily attendance. Accepts teaching assignments as 
scheduled. 

2 Marginal Occasionally fails to meet class. Dismisses students early from 

class. Explains attendance requirements at beginning of quarter. 
Fails to keep daily attendance, but has a general idea of who 
misses class. Usually accepts teaching assignments. 

/ Unacceptable Occasionally fails to meet class without notifying students. Fails 
to begin and end classes promptly. Does not encourage or record 
daily attendance. Accepts teaching assignments after a con- 
frontation. 

2. Methods of Instruction/Content Knowledge - Presents lectures, demonstrations, 
or provides laboratory supervision using appropriate methods of instruction and 
resources. Provides out-of-class assistance when necessary. 

5 Exceptional Uses a variety of methods, aids, and resource people as pan of 

presentations. Identifies objectives clearly and teaches to fulfill 
the objectives. Demonstrates mastery and comprehensive 
knowledge in subject area. Encourages student involvement. 
Stimulates and maintains student interest. Solicits students to 
investigate coursework outside of class. 

4 Very Good Uses a variety of methods and aids to increase students' interest. 

Teaches to specific objectives thereby wisely using class time. 
Exhibits conceptual knowledge in subject area. Presents mate- 
rials which enhance instruction and student learning. Involves 
students in presentations. Assists students outside of class when 
needed. 

3 Acceptaf>le Varies method of presentation to increase student interest. 

Establishes class objectives. Demonstrates knowledge of subject. 
Encourages student participation. Encourages students to seek 
additional help outside of class. 
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2 Marginal Generally uses same method of presentation. Occasionally loses 

sight of objectives during class time. Demonstrates knowledge in 
subject area. Presents essential information. Answers student 
questions, but fails to involve students in presentations. Is avail- 
able for outside help when needed. 

1 Unacceptable Strays from subject matter during classes. Exhibits minimal 

knowledge of subject matter. Discourages student participation. 
Unavailable to students seeking help outside of class. 

Presentation of Instruction - Provides formalized verbal instruction to students. 

5 Exceptional Demonstrates exceptional verbal communications with students. 

Gains students' attention quickly. Usually presentations are both 
captivating and highly informative. Instructional style is praised 
by students and is conducive to student learning. 

4 Very Good Demonstrates excellent classroom presence. Communicates 

using a wide range of verbal skills which greatly enhance the 
learning environment. Students look forward to his/her classes. 
Students respond to instructional style gaining conceptual knowl- 
edge of material. 

3 Acceptable Presents information with adequate verbal skills. Maintains 

students' attention. Students gain essential information. 

2 Marginal Communicates information but fails to regularly maintain 

students' attention. Students gain essential information. Slow to 
adjust instructional style to needs of students. 

1 Unacceptable Presentations are less than adequate due to lack of preparation, 
confusion, poorly modulated voice, monotony, grammatical 
errors, distracting mannerisms, etc. Learning is an ordeal for 
students. Fails to monitor and adjust teaching style to encourage 
student attentiveness. 

Student Evaluation - Provides opportunity for student evaluation of course and 
instructor, reviews evaluations, and utilizes results. 

5 Exceptional Serves as a resource person or exhibits leadership in developing 

or refining evaluation procedures. Attends workshops and con- 
ducts research related to student evaluations of instructors. In 
addition to the administration's quarterly evaluations, administers 
alternative forms of evaluations for more personal and specific 
feedback. Thoroughly reviews strengths and weaknesses as 
viewed by students. 
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5. 



4 Very Good Assists administration in developing adequate evaluation proce- 
dures. Administers evaluations according to established proce- 
dures. Reviews results and takes steps to incorporate recommen- 
dations in future instructional endeavors so to minimize any 
weaknesses and capitalize on 'he strengths. 

3 Acceptable Administers student evaluations according to established proce- 
dures. Reviews results and uses feedback to improve teaching. 

2 Marginal Generally follows established procedures in process of evalu- 
ation. Fails to utilize the results of students' responses. 

/ Unacceptable Fails to follow established procedures for students to evaluate 
course or instructor. 

Pre and Post Clinical Conferences (Nursing) - Conducts pre and post 
conferences to prepa r e students for clinical experiences and to evaluate the day's 
activities. 



5 Exceptional Assumes the role of a group leader in conducting pre and post 
conferences. Uses creative strategies for gaining students' atten- 
tion. Promotes an understanding of important concepts. Demon- 
strates exceptional ability to inspire creative thinking among 
students. Expectations include a sophisticated level of active 
student participation. Facilitates students to integrate subject 
matter knowledge and theory into practical application. Students 
look forward to conferences ana eagerly participate. 

4 Very Good Implements objective of the day by encouraging students' 
suggestions as to how the objective could be achieved. Makes an 
effort to involve all students. Uses post conference to follow 
through with the objective in practice. Maintains flexible format 
to include unforeseen situations that may occur. 

3 Acceptable Conducts pre and post conferences in a non-threatening, student- 
oriented atmosphere. Uses objective of the day to relate theory to 
practice and suggests possibilities of application to students. 
Elicits student input. Uses post conference to follow up on con- 
cepts introduced during the pre conference. 

2 Marginal Conducts pre conferences using a lecture format. Gives assign- 
ments and objective for the day. Elicits minimal student input 
and offers little discussion of how to meet the objective. Post 
conferences recount activities rather than tie experiences to 
objective. 
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1 Unacceptable Conducts brief and/or incomplete pre and post conferences. 

Makes assignments for the day with no discussion of how objec- 
tive might be met. Atmosphere is teacher-directed with no 
student input or direction of how to meet the objective. 



6. Clinical Instruction (Nursing) 
facility. 



Supervises and instructs students in clinical 



5 Exceptional Demonstrates substantial expertise in clinical area. Demonstrates 
an up-to-date comprehensive knowledge base of clients' medical 
regimens. Manages own time wisely by organizing the environ- 
ment and situations for the benefit of both students and clients. 
Skillfully challenges students' higher order thinking skills and 
promotes an atmosphere of inquiry. Meticulously monitors 
students' activities with clients by clarifying, verifying, and 
amplifying students' assessment of the situation. 

4 Very Good Demonstrat s expertise in clinical area. Is up-to-date on clients' 
conditions at ail times and knows clients' medical care plans. 
Efficiently organizes self and students to meet clients' needs and 
students' objectives. Maintains careful balance between eliciting 
responses from students and giving direct answers when neces- 
sary. Carefully monitors students' activities with clients. Veri- 
fies students' assessments of clients and assists students in clari- 
fying and refining their skills. 

3 Acceptable Demonstrates overall competence in clinical area. Knows 
clients' diagnoses and treatment regimens. Organizes self and 
students to meet the needs of clients within the clinical facility. 
Encourages students' to discover answers on own, but provides 
answers if necessary. Supervises students' activities with clients. 
Observes all invasive procedures and medications. 

2 Marginal Exhibits basic knowledge in clinical area. Is aware of clients' 
diagnoses and treatment regimens. Ineffectively organizes 
students in meeting clients' needs. Directly instructs students 
rather than eliciting *heir ideas. Casually supervises students' 
activities with clients. 

/ Unacceptable Exhibits deficiencies in clinical knowledge. Is minimally aware 
of clients' diagnoses and treatment regimens. Is very disorga- 
nized, finding it difficult to supervise students and meet clients' 
needs. Inhibits students' thinking for themselves. Provides little 
supervision of students' activities with clients. 
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C. Testing/Evaluation 

1. Evaluation Development and Administration - Develops and administers tests or 
other methods for measuring student achievement, and informs students of evalu- 
ation procedures and criteria. 

5 Exceptional Develops tests or other procedures that utilize different item 
forms or data collection efforts which not only are congruent 
with the instructions being evaluated but which also tap students' 
strengths. Attends workshops aimed at improving evaluation 
methods. Elicits and considers students' input regarding evalua- 
tion format. Conducts reliability and validity studies of evalu- 
ation procedures. 

4 Very Good Carefully weighs different measures to ensure that evaluation 

data gathered is congruent with course objectives. Provides 
comfortable conditions for evaluations. Allows adequate time for 
test completion or assignments. Ensures that evaluation proce- 
dures are reliable and valid. 

3 Acceptable Uses a variety of methods besides tests for assessing student 

achievement/performance. Uses statistical methods of analysis 
when appropriate. Discusses methods of evaluation with 
students. 

2 Marginal Develops and uses tests to measure students' achieve- 
ment/performance. Informs students of procedures to be used. 

1 Unacceptable Utilizes subjective methods insufficient to assess students' 
achievement/performance. Fails to inform students about evalu- 
ation procedures. 

2. Feedback to Students - Provides results and critiques tests and other evaluations, 
records scores and corrections. 

5 Exceptional Provides immediate feedback to students by reviewing tests or 

performance during class following administration. Grades and 
returns evaluations the next class day. Provides explanatory 
comments (on evaluation) to clarify answer. Critiques test in 
class, adjusts scores when appropriate. Allows students opportu- 
nities to defend their answers or opinions if appropriate. 
Provides information from test analysis to students. 

4 Very Good Usually returns evaluations/assignments by the next class 

session. Explains scoring procedure. Reviews all items, adjust- 
ing for errors in scoring. Informs students of the range of scores 
and the appropriate descriptive statistics. 
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3 Acceptable Usually returns tests/assignments within one week. Answers any 

student questions. Does not review every item. Clarifies areas of 
confusion and reteaches if necessary. 

2 Marginal Returns evaluation results before next evaluation with little 

explanation of scores and no critique. Allows students with 
questions to come by office or stay after class. Records scores. 

/ Unacceptable Feedback from evaluations is delayed. Fails to provide evalu- 
ation results before next evaluation. Neglects to regularly inform 
students of their progress during the course. 

Final Exams ana Grades - Files copies of examinations with Dean. Following 
exam schedule, computes final course grades and submits grades to Registrar. 

5 Exceptional Always administers final exams according to schedule. Consis- 
tently files copy of all exams with Dean of Instruction before 
designated time. Computes final course grades and files these 
with the Registrar before designated time. Submits grade sheets 
and attendance reports for classes. 

4 Very Good Administers final exams according to schedule. Files on time 

copies of all exams with Dean of Instruction. After grading 
exams, computes final course grades and submits appropriate 
documents to Registrar before designated time. 

3 Acceptable Administers final exams usually adhering to schedule. Files 

copies of all exams with the Dean of Instruction. Submits course 
grades to Registrar by designated time. 

2 Marginal Administers final exams, other than during exam schedule. Fails 
to file copies of exams on time with the Dean of Instruction. 
Usually submits course grades to Registrar on time. 

/ Unacceptable Administers little, if any, final evaluation procedure. Usually 
submits final course grades to Registrar late. 

Pre and Post Clinical Conferences (Emergency Medical Technician-EMT) - 

Conducts pre and post clinical conferences to determine value of clinical experi- 
ences to students and assesses student progress. 

5 Exceptional Effectively uses clinical conferences as a way to know each 

student personally. Provides an atmosphere of professionalism. 
Is available for discussing clinical issues at times other than 
regular conference hours. Encourages students' self-appraisal of 
their clinical performance. Uses clinical evaluations as a medium 
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to build on students' strengths and concentrate on reducing any 
deficiencies. 

4 Very Good Makes an effort to hold pre and post conferences in an 

atmosphere of supportive learning rather than evaluation. Main- 
tains a flexible format in conferences in order to accommodate 
for any unforeseen situations that may occur. Actively assists 
students in discovering how to improve their decision-making 
skills. 

3 Acceptable Conducts necessary pre and post conferences. Encourages 

student input, offers support, gives advice, and redemonstrates 
skills when necessary. Thoroughly explains and follows through 
on clinical objectives. Demonstrates an acute interest in 
students' perceptions of clinical experiences. Accepts sugges- 
tions for improvement. 

2 Marginal Conducts pre and post conferences as necessary to evaluate 
previous clinical experiences. Uses conferences to make assign- 
ments. Allows student feedback regarding their experiences. 

/ Unacceptable Uses pre and post conferences chiefly for assignment purposes. 

Meets with students infrequently. Limits student input. Fails to 
critically evaluate feedback or consider alternate action. 

D. Student Affairs 

1. Advising - Assists students in cours^ selection and career planning. Refers 
students to proper resources for personal counseling. 

5 Exceptional Guides students to discover their own careei goals and directions. 

Refers students to knowledgeable persons in area of career 
interest. Exhibits concern for students with personal problems 
and refers them for personal counseling. Contacts advisees who 
fail to attend sessions with faculty advisor. 

4 Very Good Maintains communication with counselors reading possible 

programs to meet students' career or personal needs Exhibits 
genuine professional interest in individual students and their 
mental health. Maintains confidentiality in all counseling 
matters. Keeps advisees informed of all commitments to 
program. 

? Acceptable Uses planned student program of study provided by the counselor 
to help advisee plan quarterly and/or yearly schedules. Exhibits 
knowledge of college and community resources for personal 
counseling and refers students appropriately. 
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2 Marginal Agrees to serve as student advisor when requested. Assists 

students in course selections. Is difficult for students to locate 
faculty member. 

/ Unacceptable Fails to work with students on course selections. Recommends 
that students seek help elsewhere. Is generally unavailable to 
students for career planning. 

Extracurricular Activities - Serves as a club sponsor for student organizations 
and participates in special campus activities. 

5 Exceptional Surveys student population to determine interests or needs not 
being met. Initiates and/or sponsors new school-wide activities 
and events. Organizes new student groups, publicizing and 
encouraging participation. Actively participates in extracurricu- 
lar activities or events. 

4 Very Good Sponsors or takes leadership role in a student club or organiza- 

tion. Engages in extracurricular aciivities or events as club spon- 
sor. Encourages faculty and student participation in campus- 
wide events. 

3 Acceptor's Sponsors events that involve students and faailty. Participates in 

campus-wide extracurricular activities or events. 

2 Marginal Attends special campus-wide events occasionally. Assists with 
club or organization; if recessary, provides minimal leadership. 

/ Unacceptable Exhibits little interest in or information about student activities. 

Rarely attends special events. Fails to assist student organiza- 
tions. 

Job Placement - Writes letters of recommendation and otherwise assisting in job 
placement as requested. 

5 Exceptional Promptly writes letters of recommendation matching students' 

knowledge, skills, and abilities against requirements of particular 
jobs. Uses a wide variety of possible sources of career informa- 
tion. Calls and makes periodic visits to piospective employers to 
locate job opportunities. 

4 Very Good Writes letters of recommendation, taking into account students' 

abilities. Uses various sources of career information. Continu- 
ously updates job announcements. Relays pertinent information 
to appropriate personnel. 
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3 Acceptable Writes letters of recommendation upon request. Posts job 
announcements and makes oral announcements to groups of 
students in related fields where applicable. 

2 Marginal Writes requested letters of recommendation after some delay. 
Posts job announcements where applicable. 

/ Unacceptable Refuses to write letters of recommendation for students. Lacks 
knowledge about area job opportunities. 

E. Administration 

Personal Office Schedule - Maintains office hours and posts and adheres to 
personal schedule. 

5 Exceptional Develops and posts a meticulous schedule. Adheres to time and 
duties specified on schedule. Posts whereabouts if not able to 
meet schedule. Always is prompt for classes and appointments. 
Routinely works on campus more than the 35 hours per week 
minimum. 

Develops and posts a detailed schedule. Usually follows sched- 
ule as posted. Meets classes and appointments on time. Works 
35 hours or more per week on campus. 

Posts schedule as required. Usually follows schedule and can be 
located when needed. Meets classes on time. Maintains 35 hours 
on campus per week minimum. 

Post schedule which denotes general rather than specific duties in 
blocks of time. Generally adheres to schedule. Is sometimes late 
for class. Usually maintains a minimum of 35 hours on campus 
per week. 

/ Unacceptable Fails to post hours and/or schedule. Difficult to locate during 
office hours. Arrives for class late. Works less than the 35 hours 
on campus per week minimum. 

Administrative Responsibilities - Performs administrative support tasks and 
carries out official policies. 

5 Exceptional Handles administrative responsibilities in an exemplary manner 
Exceeds required or expected administrative performance stan- 
dards. Analyzes data from reports and makes recommendations. 
Assists in the development of policies. Contributes to the devel- 
< nment of reports, forms, records, and other materials. 



4 Very Good 



3 Acceptable 



2 Marginal 
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4 Very Good Consistently performs administrative responsibilities in a profes- 

sional manner. Makes special effort always to comply with offi- 
cial polices. Carefully checks reports and other requested 
materials for accuracy and usually submits them early. 

5 Acceptable Performs administrative responsibilities. Complies with official 

policies. Prepares accurate reports and other requested materials 
and submits them on time. 

2 Marginal Usually performs requested administrative responsibilities. 

Generally complies with official policies. Submits reports and 
other requested materials occasionally late or improperly 
prepared. 

/ Unacceptable Neglects to perform required administrative responsibilities. 

Acts contrary to official policies. Submits late or poorly prepared 
reports and other requested materials. 

3. Supply Econom) - Conserves expendable supplies and accounts for and takes care 
of equipment. 

5 Exceptional Continuously practices supply economy. Maintains accurate 
inventory control records of assigned equipment. Reads techni- 
cal/operator manuals and arranges for preventive maintenance. 
Immediately attends to requests and follows up on needed 
repairs. Considers needs of others in using item of equipment. 
Always follows proper checkout and return procedures for 
equipment. 

4 Very Good Makes special effort to economize on supplies. Maintains 
inventory control records of assigned equipment. Promptly 
arranges for repairs and maintenance. Ensures that proper 
checkout and return procedures are followed. 

3 Acceptable Conserves supplies. Accounts for items of equipment. Reports 

needed repairs and maintenance. Follows proper checkout and 
return procedures. 

2 Marginal Generally conserves supplies. Can usually locate items of 
equipment. Fails to be knowledgeable about necessary repairs 
and maintenance schedules. Normally iollows proper checkout 
and return procedures. 

/ Unacceptable Wastes supplies. Is unaccountable for loses or damages in 
equipment. Neglects to follow proper checkout and return pro- 
cedures. 
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4. Interpersonal Communications - Communicates and interfaces with colleagues 
and administration both on a one-on-one basis, in faculty committees, and in other 
group settings. 

5 Exceptional Assumes proactive leadership role in all types of situations by 
providing innovative solutions and inspiration to others. Carries 
out and follows up on assignments. Resolves conflicts even in 
stressful situations. Is highly regarded and influential among 
colleagues. 

4 Very Good Assumes leadership role with individuals and groups. Attempts 
to resolve problems amicably. Carries out assignments promptly. 
Establishes effective and productive relationships with 
colleagues. 

3 Acceptable Works effectively with individuals and groups. Attends neces- 
sary meetings. Offers suggestions to problems. Willingly 
accepts and carries out special assignments. Assumes collegial 
role. 

2 Marginal Usually works with individuals and attends meetings. Accepts 
and carries out special assignments when required. Conflicts 
with colleagues are rare. 

/ Unacceptable Refuses to work with individuals. Absent from required meet- 
ings. Refuses assignments. Is occasionally indifferent, antago- 
nistic, or disruptive. Conflict with colleagues occur. 

F. Professional Development 

1 . Independent SelMmprovement - Keeps informed of new information relating to 
subject area, including better teaching methods and techniques. 

5 Exceptional Maintains professional membership(s) and may hold a leadership 
position within a professional organization. Reads and 
researches information from professional journals. Initiates 
research projects in area of specialty. Holds appropriate terminal 
degree. Pursues academic work beyond the terminal degree. 

4 Very Good Maintains membership(s) in a piofessional organization. Seeks 
new sources of information and uses resources of organization to 
enrich knowledge of subject matter or techniques of instruction. 
Confers with faculty members in other schools, universities, or 
research institutions. Progresses toward attaining appropriate 
terminal degree. 



ErJc 



Appendix A 151 



3 Acceptable Seeks information in subject areas and keeps updated on latest 
developments in subject area or in related field. Holds appropri- 
ate master's degree in current subject area. Makes progress 
toward one year of advanced study in subject area. 

2 Marginal Reads material available through college in subject areas and in 
field of education. Holds appropriate master's degree in subject 
area of instruction. 



/ Unacceptable Does little or no independent reading in subject area or teaching 
methods. Makes little or no progress toward eliminating noted 
deficiencies in subject area or in teaching methods and tech- 
niques. 

2. Classes and Workshops - Participates in programs, workshops, and classes to 
maintain credentials and competencies in subject area. 

5 Exceptional Organizes and/or leads special in-service programs or workshops 
in subject area. Stimulates interest in new area for possible study 
which addresses an identified need. 

4 Very* Good Prepares and/or presents a segment of a workshop or program in 

subject area. Maintains professional credentials. 

3 Acceptable Attends and actively participates in programs, workshops, and 
classes designed for maintaining credentials and competencies. 

2 Marginal Participates in only those classes or programs mandatory for 
maintaining credentials. 

/ Unacceptable Refrains from participating in m-service programs, workshops, or 
advanced study to maintain credentials and competencies in 
subject area. 

G. Community Service 

1. Extension - Serves as a resource person in area of expertise for community organi- 
zations, businesses, or special events. 

5 Exceptional Provides major leadership for public service activities, commu- 

nity businesses, and organization upon request. Advises area 
businesses of possible services. Actively serves on organiza- 
tional boards for special events or program. Takes responsibil- 
ity for special events in area of expertise. Analyzes area needs 
for possible new programs or events. Submits informative and 
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timely news releases regarding relevant educational information 
and opportunities. 

4 Very Good Promotes and carries out public service activities. Serves on 

organizational boards for special events or programs. Submits 
informative and timely new releases regarding relevant educa- 
tional information and opportunities. Provides education to the 
public by writing newspaper articles on subjects of general 
interest and submitting them for approval. 

3 Acceptable Carries out public service activities. Makes formal presentation 

in area of expertise to lccal clubs and organizations when 
requested. Provides information to media when appropriate to 
publicize programs or special events. 

2 Marginal Will usually attend community programs and share information 

in aiea of expertise. Submits necessary information to media 
when requested. 

/ Unacceptable Avoids participation in public service or extension programs. 

Neglects to provide information to media when appropriate. 

2. Communit} Relations - Represents the institution and contributes to the welfare 
of the community through participation in civic affairs. 

5 Exceptional Projects an extrenHy positive image of the institution. Serves in 

a leadership capacity in several different areas of community life. 
May serve as chairperson for special events. Acts as stimulus for 
new ideas for improving quality of community life. 

4 Very Good Is an asset to the institution. Maintains interest in several aspects 

of community life, taking a leadership role in at least one. 

3 Acceptable Positively represents the institution. Attends some community 

events, providing a supportive role in special area of interest. 
Carries out responsibilities when asked. 

2 Marginal Is not particularly identified with the institution. Attends some 
community events. 

/ Unatteptabk Projects a negative image of the institution. Exhibits little or no 
interest or involvement in community activities. 
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3. Continuing Education Instruction Teaches continuing education classes, keeps 
special groups updated on Emergency Medical Technician (EMT) standards, and 
teaches skills and competencies to health professionals. 

5 Exceptional Works with area health professionals to develop new courses or 
revise old ones. Works on regional, state, or national committees 
to evaluate current teaching requirements and maintenance of 
credentials. Develops and teaches innovative and state-of-the-art 
material in classes. Communicates latest EMT standards. 

4 Very Good Writes letters, sends out brochures, or otherwise communicates 
with former students, clinical units, and college administration to 
keep them apprised of current EMT standards. Develops and 
teaches up-to-date information in classes. 

3 Acceptable Plans and teaches classes for health professionals to keep them 
proficient in EMT skills and competencies, in addition to teach- 
ing the required classes. 

2 Marginal Teaches the required minimum hours of continuing education 
classes in order to maintain EMT credentials. 

/ Unacceptable Teaches less than the minimum number of hours of continuing 
education classes to maintain EMT credentials. 
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PERFORMANCE 
APPRAISAL FORM 

PART 1 IDENTIFICATION 


■ 

a) 


Southern Union State 
Junior College 


Name 


Rating Scale Key 


Pos,. n Library Technician 

Rating PftnnH Prnm Tn 

Ralftr Namft 

Rater Title 

Department 

Date Emplnyftri 


3 Fails to Meet Job Requirements 
CD Essentially Meeti Job Requirements 
0} Fully Meets Job Requirements 
0 Moots Job Requirements with 

Distinction 
CD Exceeds Job Requirements 



PART II RATING SCALES FOR MAJOR RESPONSIBILITIES 



A Physicia! Processing PCT 35% 


RATING 


a 


3 

□ 


3 

□ 


4 

□ 


ft 

□ 


Creating and maintaining recofds, and correctly performing 
related tasks needed to facilitate locating and obtaining library 
materials. 


COMMENTS 


B Ciiculation PCT 20% 


RATING 


a 


3 

□ 


3 

□ 


4 

□ 


ft 

□ 


Carry ng out prescribed procedures, and accurately maintaining 
records regarding the borrowing of books and other materials 
by library users. 


COMMENTS 


C Acquisition PCT 15% 


RATING 


□ 


3 

□ 


3 

□ 


4 

□ 


ft 

□ 


Ordering and receiving books, periodicals, and other materials, 
and accurately maintaining records 


COMMENTS 


0 Reference PCT 10% 


RATING 


□ 


3 

□ 


3 

□ 


4 

□ 


ft 

□ 


Assisting library users by providing information services, 
answering questions, assisting in locating library materials, and 
integrating information into cataloging system. 


COMMENTS 


E. Cataloging and Classification pct 10% 


RATING 


□ 


3 

□ 


3 

□ 


4 

□ 


ft 

□ 


Accurately compiling information and properly entering 
classifications of library materials, and integrating information 
into cataloging system. 


COMMENTS 


F. General and Administrative PCT 10% 


RATING 


□ 


3 

□ 


3 

□ 


4 

□ 


□ 


Carrying out administrative support services and activities in 
accordance with institution policies and procedures 


COMMENTS 


G PCT % 


RATING 


n _ 


2 

□ 


3 

□ 


4 

□ 


□ 




( OMMENTS 













9 
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PART ill RATING SCALES FOR MAJOR RESPONSIBILITIES 



A INSTRUCTIONAL PLANNING AND PREPARATION 


(10%) 




1 




Rating 
2 3 4 


5 


1. Course Development 

2. Instructional Preparation 

3. Clinical Preparation (Nursing) 

4. Clinical Planning (EMT) 




















Comments 










B INSTRUCTION 


(50%) 




1 




Rating 
2 3 4 


5 


1 Schedule and Attendance 

2 Method of Instruction 

3 Presentation of Instruction 

4 Student Evaluation 

5 Pre and Post Clinical Conferences (Nursing) 
6. Clinical Instruction (Nursing) 




















Comments 










C TESTING/EVALUATION 


(10%) 




1 




Rating 
2 3 4 


5 


1. Evaluation Development and Administration 

2. Feedback to Students 

3. Final Exams and Grades 

4 Pre and Post Clinical Conferences (EMT) 




















Comments 










D. STUDENT AFFAIRS 


(10%) 




1 




Rating 
2 3 4 


5 


1. Advising 

2 Extracurricular Activities 

3 Job Placement 




















Comments 
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E ADMINISTRATION 


(10%) 




i 


Rating 
2 3 


4 


5 


1 Personal Office Schedule 

2. Administrative Responsibilities 

3 Supply Economy 

4 Interpersonal Communications 






















Comments 




















F PROFESSIONAL DEVELOPMENT 


(5%) 




1 


Rating 
2 3 


4 


5 


1 Independant Self-Improvement 

2 Classes and Workshops 


□ 

n 


□ 

n 


□ 

n 










Comments 


















G COMMUNITY SERVICE 


(5%) 




1 


Rating 
2 3 


4 


5 


1 Extension 

2 Community Relations 

3 Confnuing Education Instruction (EMT) 






















Comments 



PART IV OBJECTIVES 

ACHIEVEMENT OF PERSONAL AND PROFESSIONAL (INCLUDING DIVISIONAL) OBJECTIVES 



OBJECTIVES NEXT REVIEW PERIOD 
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PART V PERFORMANCE DISCUSSION AND SUMMARY 

DESCRIBE THE FACULTY MEMBER'S STRONG POINTS 



DESCRIBE ANY AREAS OF WEAKNESS 



DESCRIBE ANY SPECIFIC ACTIONS NEEDED TO IMPROVE PERFORMANCE 



SUMMARIZE OVERALL PERFORMANCE AS DETERMINED IN YOUR JOINT DISCUSSION 



PART VI SIGNATURES 



This report is based on my observation and 
knowledge of both the faculty member and the 
job. 



Division Chair 



Date 



My signature indicates that I have reviewed this 
appraisal. It dof s not mean that I agree with the 
results 



Dean of Instruction 



Date 



Faculty Member 



Date 
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Exhibit 5 



Exhibit 5 is a set of behavioral observation scales for the same faculty position. In 
this case the individual is observed and rated on a five-point Likert-type scale as to the 
frequency of the observed behavior. In completing the appraisal, the department head 
circles 1 if the individual has engaged in the behavior 0-64 percent of the time, 2 if 65- 
74 percent, 3 if 75-84 percent. 4 if 85-94 percent, and 5 if 95-100 percent. A total score 
is determined by summing the responses to all behavioral items 



o If: - 
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Behavioral Observation Scale (BOS) for Appraising Faculty 

A. Performance Dimension of Instructio ml Planning and Preparation 

Assumes a leadership role in divisional planning meetings and other aspects of 
curriculum development. 

Almost Never 12 3 4 5 Almost Always 

Shares responsibilities in divisional planning meetings regarding course develop- 
ment. 

Almost Never 12 3 4 5 Almost Always 

Makes valid suggestions regarding course offerings and/o* modifications of current 
offerings. 

Almost Never 12 3 4 5 Almost Always 
Server as a resource person in specialty area to colleagues. 

Almost Never 12 3 4 5 Almost Always 
Updates and submits course outlines (syllabi) on time to Dean's office. 

Almost Never 12 3 4 5 Almost Always 
Suggests way to improve current course/program offerings. 

Almost Never 12 3 4 5 Almost Always 

Selects and uses textbooks that currently reflect the latest technology and practices 
in the field. 

Almost Never 12 3 4 5 Almost Always 

Develops, maintains, and previews additional resources, such as films or tapes for 
reference, timing, and quality. 

Almost Never 12 3 4 5 Almost Always 

Utilizes a variety of teaching methods and aids. 

Almost Never 12 3 4 5 Almost Always 
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Develops outlines and notes which cover the key concepts of the course objectives. 

Almost Never 1 2 3 4 5 Almost Always 
Presentations are implemented emphasizing key concepts. 

Almost Never 1 2 3 4 5 Almost Always 

Comprehensively integrates lecture, etc. with textbook and/or other relevant 
curricular materials. 

Almost Never 1 2 3 4 5 Almost Always 

Lectures are planned to promote inquiry ana decision-making skills among students 
in order to solve problems. 

Almost Never 1 2 3 4 5 Almost Always 
Instructional times is optimally planned for benefit of students. 

Almost Never 12 3 4 5 Almost Always 
Arrives for class prepared with necessary materials for classroom instruction. 

Almost Never 1 2 3 4 5 Almost Always 
Meets regularly with clinical staff or head nurse. 

Almost Never 1 2 3 4 5 Almost Always 

Interactions with facility staff reflects a mutual respect and appreciation of the 
clinical facility and nursing program. 

Almost Never 12 3 4 5 Almost Always 

Implements strategies to improve and facilitate optimal clinical experiences for 
students. 

Almost Never 12 3 4 5 Almost Always 

Critically assesses students' progress with the clinical program. 

Almost Never 12 3 4 5 Almost Always 

Arranges and modifies clinical experiences in order to ensure that students' needs 
are being met. 

Almost Never 1 2 3 4 5 Almost Always 
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Possesses indepth knowledge of the facility's system. 

Almost Never 1 2 3 4 5 Almost Always 
Follows facility's routine, procedures, and regi.^r oris in clinical programs. 

Almost Never 1 2 3 4 5 Almost Always 
Acts as a facilitator to clinical staff in updating plans for clinical experiences. 

Almost Never 12 3 4 5 Almost Always 

Cor ducts meetings with supervisors in clinical facility to plan assignments, 
experiences, and schedules in order to promote students* overall development and 
attainment of course objectives. 

Almost Never 12 3 4 5 Almost Always 

Monitors student progress throughout the quarter b> encouraging feedback from 
supervisors on students' performances and experiences. 

Almost Never 1 2 3 4 5 Almost Always 

Modifies experiences or assignments of students as deemed necessary. 

Almost Never 12 3 4 5 Almost Always 

Promotes and actively works toward maintaining a program that ensures students 
of positive clinical experiences. 

Almost Never i 2 3 4 5 Almost Always 

Assesses how clinical experiences and assignments are meeting students' needs. 

Almost Never 1 2 3 4 5 Almost Always 

Acknowledges input from students as a possible wav to improve clinical 
experiences. 

Almost Never 12 3 4 5 Almost Always 

Total 



♦ ♦ ♦ ♦ ♦ 
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5 



5 



Almost Always 



Almost Always 



Almost Always 



Almost Always 



B. Performance Dimension of Instruction 
Meets class as scheduled. 

Almost Never 12 3 4 
Conducts class for full time period ar scheduled. 

Almost Never 12 3 4 
Encourages attendance throughout the quarter. 

Almost Never 12 3 4 
Records daily attendance. 

Almost Never 12 3 4 
Accepts teaching assignments willingly as scheduled. 

Almost Never 12 3 4 5 Almost Always 
Notifies students in advance if class will be cancelled. 

Almost Never 12 3 4 5 Almost Always 
Makes alternate arrangements if class is not to meet. 

Almost Never 12 3 4 5 Almost Always 
Uses a variety of methods, aids, and resource people as part of presentations. 

Almost Never 12 3 4 5 Almost Always 
Establishes and teaches to clearly identified objectives. 

Almost Never 12 3 4 5 Almost Always 
Demonstrates mastery and comprehensive knowledge in subject area. 



Almost Never 12 3 4 
Encourages student involvement and participation. 

Almost Never 12 3 4 
Stimulates and maintains student interest. 

Almost Never 12 3 4 



5 



Almost Always 



Almost Always 



Almost Always 
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Involves students in presentations. 

Almost Never 12 3 4 5 Almost Always 
Assists students outside of class 

Almost Never 1 2 3 4 5 Almost Always 
Lectures are presented at an appropriate volume, tone, and rate of speech. 

Almost Never 1 2 3 4 5 Almost Always 
Demonstrates exceptional verbal communication s/rapport with students. 

Almost Never 1 2 3 4 5 Almost Always 
Gains students" attention within the fir:t five minutes of clnss. 

Almost Never 1 2 3 4 5 Almost Always 
Instructional style is praised by students. 

Almost Never 1 2 3 4 5 Almost Always 
When needed, modifies instructional stvle in order to maintain students' attention. 

Almost Never 12 3 4 5 Almost Always 
Students gain essential information. 

Almost Never 1 2 3 4 5 Almost Always 
Assists administration in developing adequate student evaluation procedures. 

Almost Never 1 2 3 4 5 Almost Always 

Serves u.i a resource person or exhibits leadership in developing or refining student 
evaluation procedures. 

Almost Never 12 3 4 5 Almost Always 

Attends workshops and conducts research in the area of student evaluations of 
faculty. 

Almost Never 12 3 4 5 Almost Always 
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Administers student evaluations according to established procedures. 

Almost Never 12 3 4 5 Almost Always 
Reviews results and uses student feedback to improve teaching. 

Almost Never 12 3 4 5 Almost Always 

Administers alternative forms of student evaluations, in addition to the administra- 
tion's quarterly evaluations in order to achieve more personal and specific feedback 
from students regarding course and faculty performance. 

Almost Never 12 3 4 5 Almost Always 

Conducts pre and post conferences in a non-threatening student-oriented 
atmosphere. 

Almost Never 1 2 3 4 5 Almost Always 

Uses objective of the day to relate theory to practice. 

Almost Never 12 3 4 5 Almost Always 

Facilitates students' learning by integrating subject matter knowledge and iheo y in 
practical application. 

Almost Never 12 3 4 5 Almost Always 

Elicits student input regarding clinical experiences and analysis of the day's 
activities. 

Almost Never 12 3 4 5 Almost Always 

When necessary, suggests possible clinical applications to students. 

Almost Never 12 3 4 5 Almost Always 

Uses post conferences to follow up on concepts introduced during the pre 
conference. 

Almost Never 12 3 4 5 Almost Always 
Assumes the role of a group leader in conducting pre ;:nd post conferences. 
Almost Never 12 3 4 5 Almost Always 
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Maintains a flexible format in conferences in order to address unforeseen situations 
that may occur. 

Almost Never 1 2 3 4 5 Almost Always 
Expectations include a sophisticated level of active student participation. 

Almost Never 1 2 3 4 5 Almost Always 
Demonstrates expertise in clinical aiea. 

Almost Never 1 2 3 4 5 Almost Always 
Uses constructive time management techniques. 

Almost Never 1 2 3 4 5 Almost Always 

Demonstrates an up-to date comprehensive knowledge base of clients' medical 
regimens. 

Almost Never 1 2 3 4 5 Almost Always 
Organizes the clinical environment to maximize efficient/effective service delivery. 

Almost Never 1 2 3 4 5 Almost Always 
Establishes an atmosphere of higher-order inquiry among students. 

Almost Never 1 2 3 4 5 Almost Always 

Monitors/supervises students' activities with clients b> clarifying, verifying, and 
amplifying students' assessments of the clinical situation. 

Almost Never 1 2 3 4 5 Almost Always 

Encourages students' to discover answers on own, but provides answers if 
necessary. 

Almost Never 1 2 3 4 5 Almost Always 
Observes all invasive procedures and medications. 

Almost Never 12 3 4 5 Almost Always 

Total 

♦ ♦ ♦ ♦ ♦ 
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C. Performance Dimension of T estingl Evaluation 

Uses a variety of methods besides tests for assessing student achievement/ 
performance. 

Almost Never 12 3 4 5 Almost Always 
Attends workshops to learn state-of-the-art in test and measurement techniques. 

Almost Never 12 3 4 5 Almost Always 
Elicits and considers students' input regarding evaluation format. 

Almost Never 12 3 4 5 Almost Always 
Assigns weights to assessment measures congruent with course objectives. 

Almost Never 12 3 4 5 Almost Always 
Allows adequate time for test completion or assignments. 

Almost Never 12 3 4 5 Almost Always 
Provides appropriate physical environment/conditions for evaluations. 

Almost Never 12 3 4 5 Almost Always 
Conducts reliability and validity studies of evaluation procedures. 

Almost Never 12 3 4 5 Almost Always 
Uses statistical methods of analysis in evaluations. 

Almost Never 12 3 4 5 Almost Always 
Discusses methods of evaluation with students. 

Almost Never 12 3 4 5 Almost Always 
Returns students' tests/assignments within one week. 

Almost Never 12 3 4 5 Almost Always 
Provides explanatory commenti (on e\ aluution) to clarify appropriate response. 

Almost Never 12 3 4 5 Almost Always 
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Critiques tests in class. 

Almost Never 12 3 4 3 Almost Always 
Answers student questions regarding evaluations. 

Almost Never 1 2 3 4 5 Almost Always 
Adjusts test scores to reflect actual credit earned when appropriate . 

Almost Never 1 2 3 4 5 Almost Always 
Allows students opportunities to defend their answers or opinions. 

Almost Never 1 2 3 4 5 Almost Always 
Explains scoring procedures for evaluations. 

Almost Never 1 2 3 4 5 Almost Always 
Informs students of the range of scores and the appropriate descriptive analysis. 

Aimost Never 1 2 3 4 5 Almost Always 
Provides clarification of test items which students question. 

Almost Never 1 2 3 4 5 Almost Always 
Administers final exams according to schedule. 

Almost Never 1 2 3 4 5 Almost Always 
Files copies of all exams with the Dean of Instruction 

Almost Never 1 2 3 4 5 Almost Always 
Submits course grades to Registrar by designated time 

Almost Never 12^45 Almost Always 
Conducts pre and post conferences in a professional atmosphere. 

Almost Never 12 3 4 5 Almost Always 



Is available to discuss clinical issues at times other ihan at regular conference 
12 3 4 5 Almost Always 



hours 

Almost Never 
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Encourages students' self-appraisal of their clinical performance. 

Almost Never 1 2 3 4 5 Almost Always 

Uses clinical evaluations as a medium to build on students' strengths while 
concentrating on reducing any deficiencies. 

Almost Never 1 2 3 4 5 Almost Always 

Assists students in learning techniques to improve their clinical decision-making 
skills. 

Almost Never 1 2 3 4 5 Almost Always 

Encourages student input, offers support, gives advice, and redemonstrates skills 
when necessary to promote students' progress. 

Almost Never 1 2 3 4 5 Almost Always 
Explains and follows through on clinical experiences. 

Almost Never 1 2 3 4 5 Almost Always 
Accepts suggestions for improving clinical experiences. 

Almost Never 1 2 3 4 5 Almost Always 
Provides an atmosphere of supportive learning rather than evaluation. 

Almost Never 1 2 3 4 5 Almost Always 

Accommodates for any unforeseen situations by conducting conferences within a 
flexible format. 

Almost Never 12 3 4 5 Almost Always 
Conducts clinical conferences to promote personal student-faculty relationships. 
Almost Never 1 2 3 4 5 Almost Always 

Total 

♦ ♦ ♦ ♦ ♦ 
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Performance Dimension of Student Affairs 

Guides/counsels students to discover their own career goals and directions. 

Almost Never 1 2 3 4 5 Almost Always 

Maintains communications with counselors regarding possible programs to meet 
students' career or personal needs. 

Almost Never 1 2 3 4 5 Almost Always 

Uses planned student program of study provided by the counselor to help advise 
plan quarterly or yearly schedules. 

Almost Never 12 3 4 5 Almost Always 
Agrees to serve as student advisor as requested. 

Almost Never 12 3 4 5 Almost Always 
Refers students to knowledgeable persons in area of career interest. 

Almost Never 12 3 4 5 Almost Always 
Demonstrates a professional interest in students' mental health. 

Almost Never 1 2 3 4 5 Almost Always 
Refers students for personal counseling when counseling is warranted. 

Almost Never 12 3 4 5 Almost Always 
Maintains confidentiality in all counseling matters. 

Almost Never 12 3 4 5 Almost Always 
Exhibits knowledge of college and community resources for personal counseling. 

Almost Never 1 2 3 4 5 Almost Always 
Continuously informs advisees of responsibilities and commitments to program. 

Almost Never 12 3 4 5 Almost Always 
Assumes a leadership role in a student club or organization. 

Almost Never 12 3 4 5 Almost Always 
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Sponsors extracurricular events that involve students and faculty. 

Almost Never 12 3 4 5 Almost Always 
Participates in campus-wide extracurricular activities or events. 

Almost Never 12 3 4 5 Almost Always 
Actively encourages faculty and student participation in campus-wide events. 

Almost Never 1 2 3 4 ,5 Almost Always 

Identifies student interests and needs not currently addressed in extracurricular 
activities. 

Almost Never 12 3 4 5 Almost Always 

Initiates new school-wide programs or organizes new student groups that further 
meet the interests and needs of the student population. 

Almost Never 12 3 4 5 Almost Always 

Writes letter of recommendation matching students' knowledge, skills, and abilities 
against requirements of a particular job. 

Almost Never 12 3 4 5 Almost Always 
Uses various sources of career information to locate job opportunities. 

Almost Never 12 3 4 5 Almost Always 
Calls and visits prospective employers to identify potential new job opportunities. 

Almost Never 12 3 4 5 Almost Always 
Routinely updates and immediately posts job announcements. 

Almost Never 12 3 4 5 Almost Always 
Informs students of job opportunities in their field of endeavor. 

Almost Never 12 3 4 5 Almost Always 

Total 



Appendix A 171 

E. Performance Dimension of Administration 
Develops and posts detailed schedule. 

Almost Never 1 2 3 4 5 Aimost Always 
Adheres to schedules as posted. 

Almost Never 12 3 4 5 Almost Always 
Posts whereabouts if not in office during scheduled office hours. 

Almost Never 1 2 3 4 5 Almost Always 
Meets classes and schedules at designated time. 

Almost Never 12 3 4 5 Almost Always 
Routinely works on campus more than the 35 hours per week minimum. 

Almost Never 12 3 4 5 Almost Always 
Consistently performs administrative responsibilities in a professiv>nal manner. 

Almost Never 1 2 3 4 5 Almost Always 
Exceeds required or expected administrative performance standards. 

Almost Never 1 2 3 4 5 Almost Always 
Prepares accurate reports ai.d other requested materials as requested. 

Almost Never 1 2 3 4 5 Almost Always 

Submits reports on time and completes other administrative support tasks as 
scheduled. 

Almost Never 12 3 4 5 Almost Always 
Complies with official policies. 

Almost Never 12 3 4 5 Almost Always 
Analyzes data from reports and makes recommendations. 

Almost Never 12 3 4 5 Almost Always 
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Assists in the development of official policies, reports, forms, etc. 

Almost Never 12 3 4 5 Almost Always 
Continually practices supply economy. 

Almost Never 1 2 3 4 5 Almost Always 
Notifies appropriate authority when certain expendable supplies are low. 

Almost Never 1 2 3 4 5 Almost Always 
Maintains accurate inventory control records of assigned equipment. 

Almost Never 1 2 3 4 5 Almost Always 
Follows proper checkout and return procedures for equipment. 

Almost Never 12 3 4 5 Almost Always 
Follows preventative maintenance schedules for equipment. 

Almost Never 1 2 3 4 .5 Almost Always 
Reports ond immediately arranges for repairs and maintenance. 

Almost Never 12 3 4 5 Almost Always 

Assumes a proactive leadership role in situations b> providing innovative solutions 
to problems. 

Almost Never 12 3 4 5 Almost Always 
Is viewed as a facilitator by colleagues and other administrators. 

Almost Never 12 3 4 5 Almost Always 
Maintains a professional and productive relationship with colleagues. 

Almost Never 12 3 4 5 Almost Always 
Attempts to resolve conflicts amicably among individuals and groups. 

Almost Never 12 3 4 5 Almost Always 
Promptly performs and follows up on assignments and commitments. 

Almost Never 1 2 3 4 5 Almost Always 
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Attends necessary meetings. 

Almost Never 1 2 3 4 5 Almost Always 

Total 

♦ ♦ ♦ ♦ ♦ 

F. Performance Dimension of Professional Development 

Maintains membership(s) in a professional organization in area of specialization. 

Almost Never 1 2 3 4 5 Almost Always 

Holds a leadership position within a professional organization in area of 
specialization. 

Almost Never 1 2 3 4 5 Almost Always 
Reads and incorporates research from professional journals in academic work. 

Almost Never 1 2 3 4 5 Almost Always 
Initiates research projects in specialty area. 

Almost Never 1 2 3 4 5 Almost Always 

Use: resources of organization to enrich personal knowledge of subject matter or 
related techniques. 

Almost Never 1 2 3 4 5 Almost Always 

Pursues advanced academic coursework beyond current academic degree. 

Almost Never 1 2 3 4 5 Almost Always 

Maintains notarity in their field among colleagues on campus, at other institutions, 
and within the state. 

Almost Never 1 2 3 4 5 Almost Always 

Organizes and leads special in-service programs or workshops in subject area. 

Almost Never 1 2 3 4 5 Almost Always 
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Assumes a leadership role in preparing/presenting a segment of a workshop or in- 
service program. 

Almost Never 12 3 4 5 Almost Always 

Maintains professional credentials. 

Almost Never 12 3 4 5 Almost Always 

Attends and actually participates in programs, workshops, and classes designed for 
maintaining credentials and competencies. 

Almost Never 12 3 4 5 Almost Always 

Total 



G. Performance Dimension of Community Service 

Provides major leadership for public service activities, community businesses, and 
organizations upon request. 

Almost Never 12 3 4 5 Almost Always 

Performs public service activities through formal presentations to local clubs and 
organizations in area of expertise. 

Almost Never 12 3 4 5 Almost Always 
Actively serves on organizational boards for special events or programs. 

Almost Never 12 3 4 5 Almost Always 
Analyzes community needs for possible new programs or events. 

Almost Never 12 3 4 5 Almost Always 

Submits informative and LimH) news releases publicizing educational information, 
activities, and opportunities. 

Almost Never 12 3 4 5 Almost Always 

Projects an extremely positive image of the institution within the community. 

Almost Never 12 3 4 5 Almost Always 
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Contributes to the welfare of the commumtj by participating in civic affairs. 

Almost Never 12 3 4 5 Almost Always 
Takes a leadership role \n at least one civic organization. 

Almost Never 12 3 4 5 Almost Always 
Acts as a stimulus for new ideas to promote the welfare of the community. 

Almost Never 12 3 4 5 Almost Always 

Works with area health professionals to develop new courses or revise old ones in 
the area of continuing education. 

Almost Never 12 3 4 5 Almost Aiways 

Works on regional, state, or national committees to evaluate current teaching 
requirements and maintenance of credentials. 

Almost Never 12 3 4 5 Almost Always 

Teaches innovative, state-of-the-art information in continuing education classes 

Almost Never 1 2 3 4 5 Almost Always 

Communicates the latest Emergency Medical Technician (EMT) standards to 
various health professional groups, former students, clinical units, and college 
administrators. 

Almost Never 12 3 4 5 Almost Always 

Total 

Performance Dimensions for Appraising Faculty Totals 

A. Instructional Planning and Preparation 

B. Instruction 

C. Testing/Evaluation 

D. Student Affairs 

E. Administration 

F. Professional Development 

G. Community Service 

Overall Faculty Performance Total 
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Appendix B: Checklist for Legal Requirements* 



This appendix addresses the major considerations involved in validating a perfor- 
mance appraisal system using a content validity strateg> It is in the form of a checklist 
for meeting minimum legal requirements. It is not a comprehensive guide to conduct- 
ing in-depth or quantitative studies. 



*The Checklist for Legal Requirements was developed b> James A. Buford, Jr. and 
Bettye B. Burkhalter, Auburn University, AL 36849. 
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Checklist for Legal Requirements 



Requirements 


Authority 


How Addressed 


DptBrminB if rontpnt validity QtrAtfifiu ic 

appropriated 


uniiurm ouiucimcs, oeo i ** \ \ ) 


A content validity strategy is appropriate for 
procedures designed to measure observable 
work behavior(s) or work product(s) 


Avoid procedures based on traits or contstructs 
such as "intelligence, aptitude, personality, 

rnmmni ^ppiqp inHnpmpnt IpaHprQhir* anH 

VsVIIIIIIVil JCIIOC! |UUUCI MCI 11, ICQVJCIOlllp ullU 

spatial ability." 


Uniform Guidelines, Sec 14 (C) (1) Wade v 
Mississippi Cooperative Extension Service, 372 


No direct measurement of traits or constructs 
should be built into the system A trait may. 
however, be inherent in a job related behavior 
or outcome 


"There should be a job analysis which includes 
an analysis of important work behavior(s) 
required for successful job performance and 
their relative importance and if the behavior 

rp<5ult<5 (n A work r>rnHuf*t Ai-iaIvqiq nf Iho vAinrk 

product(s)" 


"Uniform Guidelines," Sec 14 [C){2)Greenspan 
v Automobile Club of Michigan, 22 FEP 195 
(1980) Albermarle Paper Co v Moody, US 
Supreme Court Nos 74-389 and 74-128, 10 FEP 

vdocb I I O I , ] y / 0 


Job analysis should be conducted fur each job 
Relative importance of job domains, or task 
areas, should be established during job analysis 
Frequency and criticality of tasks should be 
established during job analysis 


"A (performance appraisal) procedure designed 
to measure work behavior may be developed 
specifically from ihe jod or joo analysis in 
question " 


"Uniform Guidelines " Sec 14 (C) (3) 


Domains indentif'ed :n job analysis can be 
defined in terms of acceptable level of job 
performance 

or 

Tasks or duties which are similar can be 
grouped together to form criterion areas 
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Checklist for Legal Requirements (continued) 



Requirements 



Authority 



How Addressed 



"To demonstrate content validity, a user should 
show that the behaviors demonstrated in the 
(performance appraisal) procedures are repre- 
sentative of behavior(s) work product(s) of the 
job" 



"Uniform Guidelines," Sec 14 (C) (4) 



Performance criteria should developed for 
critical and important duties in each domain and 
weighted in accordance with the overall 
importance of the domain 



'The manner and setting of the (performance 
appraisal) procedure should closely approxi- 
mated the work situation." 



"Uniform Guidelines." Sec 14 (C) (4) 



Performance criteria should be described in 
terms of actual job conditions 



The performance appraisal process should be 
administered under controlled and standardized 
conditions 



Brito v Z\a Company, 478 F 2d ^200 (1973) 



A performance appraisal instrument should be 
developed The instrument should facilitate the 
rating process and be keyed to both the criteria 
and method Provisions should be made for 
weighting the ratings according to the rules of 
combination Indentification, comments, and 
signatory sections should be included 



A report or memorandum of how the system was 
developed should be prepared 



Vulcan Pioneers, Inc v New Jersey Department 
of Civu Service. 588 F Supp 732(DCNJ 1984) 
"Uniform Guidelines," Sec 1 5 (C)(1 -9) 



A content validity report should be prepared 
This report should include as a minimum user(s), 
location(s), and date(s), job analysis - content 
of thejob.performance appraisal procedure and 
its content, relationship between performance 
appraisal procedure and the job, alterative 
procedures investigated, uses and applications, 
contact person, accuracy and completeness 
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Developed by James A Buford, Jr and Bettye B. Burkhalter (1988). Auburn, University, Alabama 36849 
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47 
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